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ABSTRACT 

^^^^ guide explores issues in' English 
proficiency testiOT^ Tests are discussed interas. of the aspect of 
language. tested, and of different kinds of teat tasks%. The following 
kinds of test task defects are treated: (1) tests that tegulred 
literacy skills, <2) tasks that reduce to a ▼ocabuiary test, and (3) 
errant/notions of liiiguistic coaplexity. Inherently fa,ulty approaches 
to testing are discussed, including aisicry, testing passive 
cosprehensiiln, inr^erring lack of control froi lick of perforaance, 
and uiitt'^ self7reported dat)i; The value of specific te»t tasks (e^g., 
vocabulary test) in deteraining overall language proficiency is 
questioned. Linguistic artificiality in tests (e.g., desanding that 
answers be in coaplete sentences) is viewed' as requiring, 
aatelinguistic knowledge froa istudents* The isplications of second 
language acquisition for lari^ruage testing are discussed. Discrete 
point tests are contrasted with' integra-J;lve tests, and thjs degree ef^ 
correspondence between test content and order of acquisition of ^ 
language skills, is exaained. ^fxaaples ffoa specific tests are used 
throughout the guide. Part Two consists ,of an annotated catalogue of 
English proficiency tesrs- Each; test is cross-referenced to -relevant . 
discussions in Part One, CJB) 
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INTRODUCTION 



One of the educational developments witnessed ili the 15)70s, which lias j^ermeated ovjt 
classroom a!id school district across the nation, has been the gradual Increasing 
roH iance on testing instruments rather than taacher judgments as sources of infornja- 
tit)n for student placement and assessment • IndQcd, teachers face a constant tension 
between validating their perc^ept ions of their student;;* progress and that roportet 
on standardized achievement tests. Until the testing developers can provide more 
curricularly tailored tests, teachers, wil 1 have to doarwith' assessment procedures 
with which they may be ujpfamiliar and/or reluctant to implement* , 

This trend is most conspicuous in the areas of second language instruction, where 
diagnosis of student ability in various aspects of language proficiency has becom<? • 
an essential part of bilingual and linglisli as a second lanjiuage (I'l^L) progriuns* 
However, one of the most universal concerns for teachers in these programs has been 
thei r- developing disaffection with assessment pro^cedures and the student evaluaticms 
for whi^h they are subsequently held accountable. Nevertheless, teachers have been 
called upon to administer measures with which they frequently are not familiar, 
which may not relate to the course of study as they have prepared it, and which may 
appear culturally or curricularly inappropriate* 

The ared* of the assessment of oral language proficiency testing for limited ^nd 
non-Knglish-speaking students is one which has primarily developed in the last lO 
years, paralleling the development of instructional methodology for bilingual educ:a- 
tion. It is ndteworthy that when bilingual programs were first federally sponsored 
in 1968 there were very few tests which attempted to assess elementary students" 
command of spoken Hnglish. What was in 9xis tence 'prs^mari ly focused on assessment 
instruments for the acquisi^tion of oral Knglish in adults. In response to a demaijid 
wlhich seemed to develop overnight, test developers struggled to provide instruc- 
tional perspnnel witli adequate measures. This created a situation where there weij^e 
many newly developed tests on the market, but their appropriateness for assessing 
specific functions rarely emanated from teacher decisions, rather frofn decisions c^f 
psychometric i'ans outside .the realm of classrooms. Teachers then found themselves 
required to 4idminister certain tests in which all of the follow^g might obtain: 
(a) the children lacked test-wise ski lis, (b) the teacher^ were unfamiliar with the 
test, (c) the teachers had no input into" test selection or administration^ (d) th^ ^ 
teachers could neVer use the test information collected, (e) the tests had littlel 
curricular'relevance, and (f) tjie tests had little cul^tural r.elevance. In a;iy of! 
these situations, it is evident* to see why disaff^tion on the part of instructioipal 



personnel with regtird to assessment procedures "and practices has developed. 

The most efficien^t v^ay to tackle this problem is for instructional personnel to 
develop competence in the areas of testing, testing development, and test interpreta- 
tion. Teachers must know ho\^ tests are d^ovelopysd, what they can actually measljire, 
what extrapolations f rom *the tests *are warranted, the deficiencies in tests, ancH, 
moreover, why ^it is necessary to use tasting instruments for assessing students 
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rather than some .other form of assessment procedure. Unfortunately, most teacher 
proservice proR<;ums cnnnot expand their ill ready crowded curricula With nddit tonal 
courses on testing. • 

It is because the isfsue of assessment is so important and relevant to the issues 
confronted by today's educators that this monograph was developed. Essentially, it 
provides instructional persojinel with the necessary background information for 
making informed choices in test selection and test interpretation. It addresses 
those issues which practitioners have consistently posed: What do tests really 
measure? ■ What typ« of student is this test appropjriate for? Can I trust the test? 
Will my students be a.dversely affected by taking the test? What can I learn from 
the test about my students? By providing the answers to these questions it is hoped 
that some of the mystique s\irrounding testing will be eliminated for instructional 
personnel. This monograph, then, is very timely in providing this basic introduc- 
tion in test development and app^cation. 

this Guide also serves two other purposes: .<a) it elaborates on the definitions for 
such concepts in bilingual and ESL programs as "language dominance" and "language 
proficiency" and (b) it reviews tests in an annotated format. Terms such as profi- 
ciency and dominance have been so popular in currpnt programmatic use that they have 
escaped consistent definition. Language proficiency in one district mdy be language 
dominance i'h ajiother. By providing an operational definition of language proficiency 
and contra^iting it with the definition of^language dominance, this book bridges the 
gulf between current research in second language acquisition and the application of ■» 
this knowledge to the classroom. 

Finally, this monograph reviews those tests which have met with the most widespread 
usage. In annotated format, each test is reviewed with a cross-reference to those . 
specific areas wKere the test may be limited. This review l^s unique from others 
recently publi<^hed in that it describes the tasks involved in the assessment pro- 
cedure, or the 'stimulus to which the student is required to respond. This feature , 
makes it very usable for instructional personnel by providing them with a better 
id^a of what tasks are required for tests they may be selecting for programmatic 
use. , 

In conclusion, A Linguistic Guide to English Proficiency Testing in -^Schools fUls a 
critical void in the proffessidnal development of teachers of limited and non-English- 
speaking students: It provides the essential background information on testing, 
•needed by today's educators, it addresses the latest issues in bilingual and ESL - 
education, and dt provides a very useful annotated list of tests in use. For the 
inservice and professional development of teachers; the book serves a practical and 
commendable function. 



Bea Arias 
September 1979 
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HNGLISH PROFICIENCY. TESTING tN SCflOOLS 

The student pop^ilation in'many U.S. school systems these days includes students 
from diverse language and cultural backgrounds; many of' whom are native speaker's 
of languages other than English/ and who va^V widely in their ability te use English 
in a school setting. Teachers and administrators in this situation have a recog- 
nized responsibility to identify students wlio have limit^ed profipiency in English 
a>id find out how well each student is able to use English for placement in an appro- 
priafe instructional program. Bat, despite widespread agreement on these goals, no 
consensus currently exists on answers to certain crucial questions. What sort of 
language ability is sufficient to enable a non-native speaker of ^nglish to gSt 
along in an English-speaking classroom, and what indicates a lack of that ability? 
•HOW can we find out just how veil a student can use English, at a given time? 

in suite of the present lack of consensus, there is some research which can form a 
prelimnary basis for angft|s to these questions. ' Furthermore, there are many 
teachers and other peoplPBrking in schools whose experience has provided them with 
at least parti^^l answers. There is also a large, and growing number of language 
assessment instruments being made available to schools, which promise to assist the 
schools in identifying and placing students of limited English-tpeaking ability. 
School systems, under pressure to demonstrate that student placiment is based on 
some reliable and val id measure of language ability, frequently face the problem of 
choosing, a test to use. This problem is compounded by the fact' tlj^t there is a 
great deal of variation among currently available tests, in terms of language con- 
tent, the types of language tasks involved in their use, scoring procedures, and 
ways to interpret sicores. 

Xhis Guide reviews a number of these tests <jand reports on a linguistic evaluation of 
their" design and content as well as introduces essential concepts in language test- 
ing. Since several pul?l ications are now available which provide psychometric data 
on tests, evaluation of their cultural appropriateness, and/or evaluation of ^h^ir 
prhctical usefulness in a school setting, we will not include those considerations 
in our reviews. Instead,, we will try to provide information about available tests 
which previous catalogues do not contain.* « ■ 

In one way or another, the tests we reviewed claim to assess students' ability to 
produce, understand, and/ or use language correctly or appropriately. Linguistics, 
as a discipliJle, deals with the structure, use, ai^d acquisition of language, and 
provides an importa-nt" framework for evaluating whether, and how well, language tests 
do what they claim. The present review i^s based on an analysis of the language of 
test items, the nature of tasks in tests, and the manner in which responses to test 
items are to be judged or scored. Given this analysis, we evaluate tests in light 
of evidence from linguistics and related disciplines about how language works, how 
it is used and how it is learned. - ' ^ 
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Kinds Of Language Tests 



r 



The language tests under discussion are generally used in schools to serve either or 
both purposes of: (a) identifying students with limited English proficiency and/or 
(b) placing students ih an appropriate type or level of instructional program (e.g.. 
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bilingual Instruction, HSOL, or a regular Kngl ish-speaking classroom). Test devel- 
opers make different xlaims for what typo of information their tests will yield 
about studdnts', language abilities. Most of the language tests we hare considered 
are claimed to as!^ess students' language proficiency, bilingual dominance, or both* 

An English language prof iciengy test is designed to provide an answer to the ques~. 
tion (roughly put): * How^well does tiie student know Fnglish? Hnglish proficiency — • 
what it is to "know" Knglish — ^^Is given ^different operational definitions in each 
theoretical, historical, ancf legislative contexts Reflecting various notions of 
what constitutes language proficiency, diff.crent tests are designed to assess stu- 
\ d0$^ts* skills in certain aspects of language use. Most tests of language proficiency 
involve the comprejiension and production of oral language. Some also include a 
component fOr- testing written language skills. In any given school situation, the 
apparent value of a test will depend in part on whether the - tef^t effectively assesses 
that array of language abilities that the school deems crucial zo stiidents* success 
in an Hngl ish-speaking classroom^. Lately, educators have spoken of the '^four skills" 
composing Ei\gl islr prof iciency : speaking, listening, reading, and writing. While we 
recognize thSt proficiency in each of these skills is ultimately essential for suc- 
cess; in ^ligl ish-speaking classrooms, we intend to focus on the oral/aural skills of 
speaking and J\istening. These are primary, in that they constitute the basj.s on ^ 
which the literacy skills of readi^ig and writing must, be built, and in that they 
must fcrm the basis of any reasonable'def inition of language prof icijency . An illit- 
erate native Hngl ish speaker is simply illiterate,, not unproficient at English.. 
HencefoVward, when we speak of language proficiency, language dominance, etc*, we 
will mean oral proficiency or dominance.- The reviews that follow will, for the most 
part, cover only those t^ests or parts of tests which claim 1?o assess speaking and 
listening ability- . Tliere,,we will touch on some of the issues involved in testings 
particular language abilities .or skills as a measure of. oral language proficiency. 

Hie question of language proficiency is frequently approached through the notion of ^ 
language dominance. A student's "dominant" language is sometimes determined on th^ 
basis of use patterns (e.gi, the language of the horhe, the language most often 
spoken, etc.) in accord with state and federal legislation, and this method (which 
oft*n yields conflicting results) of determination is increasingly supplemented with 
a test of dominance. A test of bilingual dominance is generally designed to deter- 
mine which of two languages students know better/less. Superficially, it might 
appear that dominance can be ascertained without simultaneously determining how well- 
students know ejich language. F-or example, the dominant language could be determined 
without determining overall language proficiency by comparing students' control over 
some small sample of each language like a l^st of words. The trouble with this 
idea, however, is the inescapable porssibility that students might perform a limited 
task (e»g. , naming pictures) better in language A than in language B, but, under 
ordinary circumstances, may be better at speaking and understanding language B than 
language A.' Unless the task in a dominance test yiejds an indicator of students' 
overall ability in each language, the test may fail to indicate language dominance^ 
(if, in fact, students even have a single dominant language) . Thus, for language 
testing, 'thp^ question of dominance* is actually a question of students' relative 
overall proficiency in one language as compared to others. Some issu.es pertaining 
to dominance testing will be discussed ^ later ^ 

There are a few tests which claim to assess students' "fluency" or "language facil- 
ity." However,' fiuenty and language facility are. g'p/en no technical definitions 
which differentiate them from language prof iciency^. 'The methods used to assess 
fluency or language facility are the same as those used in some language proficiency 
tests and, in practice, * t6sts which claim to measure' fluency or language facility 
appear to be used as language proficiency tests. ^ 

Some tests are presented as tests of "achievement/!^' Of course, achievement gan only 
be measured in terms of progress towarcl some specified goal. Generally, achievement 



is measured in terms of mastery of specified curriculum objectives, as in an HSOL 
program. lii those cases, tho valuo of aii iiclnevemont tost a measure oji* students* 
overall l-nglish ability depends partly on the value of the curriculum. A tdst based 
on a particular set of curri(;ulum Objectives will measure overall I-nglish proficiency 
only insofar as tliose objectives actually comprise what -it^ is to "know Hnglii^^h, and 
those objectives reflect the order and patterns in which Knglish is naturally 
acquired as a second,. 1 anguage. A cons iderable runount of research indicates that 
children acquire the gramniatjcal structures of English in, a systematic, regular way, 
but^the order of acquisition so far has been documented for only a limited number of 
grammatical morphemes. Research has not yet established an overall picture of the 
English acquisition hierarchy in sufficient detail to serve as the basis for an 
entif'e BSOL curriculum. On the other hand, due to the time lag winch often sepa- 
rates research findings and their practical application, most iiSOL curricula pres- 
ently do not even^reflect the considerable evidence winch already exists for sequence 
in the acquisition process. In general, we can -expect that achievement tests based 
on a list of ^specific curriculum objectives will be of limited value as tests of 
overall f:nglish proficiency. 

Some tests, finally, claiiiTto be "diagnostic." A test is diagnostic if it gives 
qualitative and quantitative information regarding students* language proficiency^.' 
A diagnostic test must do more than assign students to some category (e.g., one', of 
several \1 afferent levels of l:nglish proficiency) on the basis of how much Englip^^ 
they know; it^must also yield information regarding aspects of the English linguis- 
tic system student^i do or do not control. A diagnostic test will be more useful aS 
a guide for language instruction because it determines precisely what students do 
not know, and only from that information can,^wc decide precisely what needs tp be 
taught. A test of language proficiency or bilingual dominance may or may not be 
diagnostic. \ 

What Tests Test: Aspects of Languag^^ ' : \ ^ 

A test uses^ a number of different methods to assess miglish proficiency, and each 
test's methods vary accprding to the component of langiiage the test selects as 
representative of the finguistic system. ^ 

Every spoken language has a' universal framework of properties, or components: 
pronunciation, grammar, vocabulary, forms of discourse, Und rUles ftor use. Together, 
these components comprise the linguistic system of a language, and the different / 
aspects of the system form a hierarchy of levels so that units at egch level are 
organized into larger units at the next level. Thus, the sounds of English are 
organized into wordsf words combine into graipmat ical structures which are orgahized 
to express various meanings, and utterances are used systematically in social situ- 
atiotiSi 7 s • ^ 

In general, when language is learned in natural social situations (i.e., in the ^ 
absence of formal instruction), the whole of a language system is acquired ill mean- 
ingful "chunks" as communicative situations require or permit. In acquiring overall 
control of a. linguistic system, the learner is gaining control of v^arious subsystems 
which can be analytically separated: pronunci'Bt ion (phonology); the grammar proper 
(syntax) ; *the vocabulary (lexicon); patterns of discourse be^K>nd the sentence; 
meanings associated with the grammar, vocabulary, and patterns of discourse (seman- 
tics) ; and the rules of use (pragmatics). 

Phonological Characteristics of English. Different^^s between sounds may signal 
differences in meaning in some languages. Where soun3>distinctions function to 
differentiate meaning, speakers of the language tend toj perceive "different sounds." 
For exartiple, the sounds of v and b constitute a functitmal contrast in English 
beccfuse they serve to differentiate between the spoken words drivel and dribble, 
vest an<i best, etc. These two sounds -do not distinguish between any such wotd .pairs 



in Spanish, and so are not functionally different in tftat langijage. Similarly, a ^ 
native speaker of ^Japanese may have Uifficulty in hearing or producing the distinc*- 
tion between the sounds of r and i--which different iates Ejiglish words such as right 
and light — because this distinction does not serve to differentiate any words in 
Japanese* Conversely, there are sounds that do not differentiate any words in Bng- 
lij^h, but do in dther languages. The sound of k in skull is acoustically and per- . 
ceptually differ^t from the sound of /c in ski, hut this is a difference that is ^ 
ignored in English. On the other l^and, a ;rurki*^h, speaker woqld quickly perceive the 
dif fereiv^e^etween the two sounds, because in*l\irkish these two sounds alone can 
serve to distinguish between different words. A person acquiring the phonologicafl 
system of a new language must learn to ignore certain differences among spoken 
. sounds, and at. the same time to perceive and attend to certain other differences, 
which are important to understanding the language, ' 

The Vocabulary of English. Th,e Tanguag-e learner must l,earn the meanings of words, 
and how meaning is affected as words occur in differwt cont^^xts* Words such as 
nouns or verbs mighl be learned explicitly as vocabulary items, but "function'* words 
(such as articles, relative pronouns, and conjunctions), which indicatei, relationships 
among other words in a sentence, must be acquired as part of'^'the process of learning ^ 
to construct sentences* 

\ The Syntactic-Semantic System of English. Learning* the syntax and semantics of / 
I English involves learning how words are organized into meaningful sentences and 
tliscourse* Hie syntactic-semantic system distinguishes a mere list of words from a 
grarmatical , meaningful sentence of English. In learning how to make an English, 
sentence, the language learner must master the grammatical relations which hold 
within sentences Students must learn, for example, (a) the different forms which 
pronouns take as /feubjects or objects (he vs. him, I vs. me); (b) the grammatical 
processes underly{ing th^ structure of sentences (forming questions, imperative or 
passive sentences^); (c) how to form embedded constructions (e.g., relative clauses: 
The man [who is] near the- door is my brother or sentential direct objects: He expects 
me to read this whole book. He knows [that] we'll be late); and (d) how to control 
grammatical relations which occur among different sentences in discourse (e.g., pro- 
nominal izat ion or Oiises of ellipsis where ten and I'm ten [biit not am ten] are gram- 
matically acceptable responses to a question like How old are you?). 

•4 

The Use of English in Different Contexts. Ehglish sentences must be more than 
meaningful and grammatical. They must be appropriate to the particular linguistic 
and social context in which they are used and communicate the speaker's intended 
meaning in that context. In learning the conventions which govern spoken English 
discourse, students come to understand how linguistic forms which are identical in 
content and structure can convey various meanings in different contexts. 

Recogni\ingythe interaction of language forms and context is a linguistic skill 
which iS'^^ndamental to understanding conversation and to being understood, Anothet 
related aspect of language use which must also be learned is how language can be 
used appropriately and effectively to perform different functions which are often 
highly specific to a given situation. 

The interrelated aspects of language are all essential to the use of English, but 
there are important differences among them in terms of how they are learned and how 
they^^ejwsrate as part of the overall knowledge of English. There is research evi- 
^^^-j^^^nce that the acquisition of grammatical structure by children learning English as 
^ ' a second language is more systematic than the learning of other aspects of the lan- 
guage; there appears to be a .regular pattern to the acquisition of English structures 
by children of diverse backgrounds artd diverse English-learning experiences. In 
contrast, how children acquire phonology, vocabulary, and the functional use of: 
English is njore likely to depend on the learner's native language, culture, individ- 
ual experience, and the nature of explicit instruction received. 




The acquisition of English grammar, then, is the most regular, systematic, and pre- 
llic table aspect oi' the 1 anKuage- 1 earn ing process. This mirrors the fact that, ^.imQng 
the various aspects of the linglish language system^ the grammatical system is most 
ui\^iformly shared by all Hnglish speakers. That is, the basic syntactic structures 
of the language are least likely to vary among speakers of different social class, 
age, sex, or ethnic or regional background, and are less likely to vary over time, 
or in different situations of use. Rach of these factors, in contra^st, tends to 
influence a s()eaker's pronunciation of the language, and tk^voeabulary controlled, 

■ 1 

V\e problem for tests of language proficiency i$ hoif to gain apCess to 'students' 
knowledge of th6 overaH linguistic system. In general, the strategy tl^at test 
developer^ take is to evaluate stydents' control over one or two of the four aspects 
of the linguistic system, on the assumption* that students' proficiency in those 
aspects of the total language systan is representative of overall ability. 

How Tests Work: Kinds of Language Test Tasks . . ' * ^ 

... ^ \ \ 

Another point of difference among tests is their method of assessing students' con-^ 
trol overv, the. aspect of language which they ,*telect to measure. Different ^^ste 
involve the student in one or more^ of the following types of tasks; ' //i 

f : ' • ' ' ■ ^ 

• Answering questions about pictures, about a disoourse, ot general questions. 

• Describing,. or telling a story about, pictures, obj ects , places, or people. 

• Parapliras ing something which is said. • * 

• Criimmat ical ly manipulating sentences--changing tense or number, conjugating 
verbs, changing sentence form, etc. 

•Completing cloze passages or sentences, 
•Repeating words, sentences, or stories. 

•Recalling words from lists of words, g^^rally presented in two languages. 
•Discriminating between words. ^ . 

•Pointing to or marking pictures, words,- sentences, or objects which correspond 
in some specified way to an oral cue. 

•Naming objects in pf^twres or in the physical environment. 

•Performing cdimi\ands. 

All of these tasks involve sti^ents in oral language processing or production, or ■ 
both. A few tests include tasks which also involve students in reading, as for ^ 
example, a test which requires students to select, from among several written sen- 
tences, one which corresponds to an orally given sentence cue. Following, we will 
discuss and.'^evaluate specific tests in terms of the aspects of language they seek to 
measure how they seek to measure them, and in terms of the tasks they impose. 

lS5?tJ^S IN XHST EVALUATION ^ ^ 

The tests to be discussed claim to measure English language prowcienc^^ qrucial 
question to ask of any English language proficiency test is whetfte^ it^does^^ 
claims to do, which is a question about test validity. ^ In evaluat^^ te%ts, the 
question of validity is by far the most important and complicated. ; 

There are various ways to po^se the question of test validity, and various ways to 
evaluate it. Most commonly, claims of test validity are supported by certain types 
of experimental evidence from stu^lies conducted over a peri/^d of time. Studies 
conducted 'to validate language proficiency tests are commonly designed to demonstrate 
that (a) a test accurately predicts some independent, but presumably relevant aspect f 
of students! future performance (e.g.^ subsequent scores on standardized achievement 



tests or success in an Engl ish'-speaking classroom as judged by a teacTler) and (b) the 
test yields results which correla^tc highly with the results of some other tests or 
assessment .procefdures whost* validity has presumably been independently established. 
Test makers may be expected to provide data from such studies in support of claims 
that a test validly measures language proficiency* When such data is provided, it 
'^shdOld bV carefully examined and .Evaluated before^^ using the test. 

Note, however, tlmt this type of experimental evidence alone does not directly assess 
whether a test actually measures proficiency in or' control of a given language/ , 

' Rather, these predicj^ion and qprrelation studies merely aHi^w u§ to infer, with 
. great ey or lesser confidence, ^hat the- test actually measures liinguage .prof iciency ♦ 
Whether or not we can pur faith in such an inference, in any one case, depends on the 

♦ relevance the validation studies to the aarsessment of . language proficiency, on our 
confidence in the research design and* procedures of the studies, and on the accumu- 
lation of empirical evidence from the s.tiidies. 

Our r^iew evaluates tests analytlcaUy rather tha^n^^experimental ly We. ask certain/' 
relevant questions of a test, andjwe seek answers by examining its design,.„4fl(htent , 
and procedures, rather th^n by dra<ving inferences .about language ability from experi- 
'mental observation of behavior that* (presumably) depends on that ability? What makes 
this approach relevant and ^essential i^ the fact that^'^every Englisti language profi- 
ciency test ref lects--impl icitly or expl icitly---a particular notion of what it is to 
'*know"" lingl ish, and that notion in each case mus\ be subjected to evaluation. A 
ldj)g(vage proficiency test may be viewed as an instrument which sets up an operational 
defini-tioh for something called language proficiency, .. Since what counts as' language 
" profic^iency miteht be conceptual ized differently by ditferent test markers,' it is 

important to a'sk whether the notion of language proficiency embodied in a particular 
test as appropriate for a given purpose (e.g., for assessing how weH a child speaks 
Hnglish in order to provide the needed instruction). Further, given a particular 
test which .embodies a p&rticular notion, of what at)ilities constirtute proficiency in 
English, it is important to ask how adequately the items on the test* sample those 
abilities--l>ow well performance on the test represents control of those abilities. 

t 

.AnswoiTS to these questions emerge from linguistic (and psychometric) analysis of 
test*. In the case of language proficiency tests, linguistic analysis is a xJoubly 
appropriate tool for evaluation^ for both the theoretical construct which the tests 

■ are intended to measure and the methods for measuring that construct are linguistic 
in nature. Our discussion is based on analysis of the language content of tests and 
t^f the nature of linguistic tasks involved in thpm. Giyen.this analysis, tests are 
evaluat^ed according to what is known about the system and sttucture of language, and 
about how children learn language. Thus, this evaluation rests on a theory-based 
understanding of how language works and of the language component the tests are 

^ designed to measure. ^ . 

For purposes of this review, two assumptions are made regarding the question of test • 
validity: (a) each partic^ilar task imposed i^ an appropriate one for assessing 
controi of some specific asjiect of language and (b) the demonstrated knotvledge of 
those specific aspects of language covered by the test indicates the level of overall 
language ability. If either of the two assumptions fails to be true (wholly or in 
part), then this damages the testes claim to be a valid measure of overall language 
proficiency. , 

Our assessment of test validity consisted of a linguistic analysis of' a testes item 
content (including the strategies for scoring performance) and a comparison of the 
oveJIill design of the test with the major compoi)ents of ^language as a structured 
system of communication. A linguistic analysis can, where Appropriate, serve to 
raise suspicions about test validity by erxposing cases of confounding* (assMjnption 

^Confounding simply means thdt.^a test item or task that has been deaign^j^^to meaaxxte^ 
knowledge of, or skill in, stmie specific aspect of language, might, in re^lity, bB^ 
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••«••) and by providlhg evidence that certain aspects of language frequently measured 
^ on proficiency tosts do not provide good indices of ov<*rM/i capahil.ity (assumption 

"b") V For each validity criterion, we present examples drawn from tests now on the 
^market or currently used in schools,' of how particular test tasks can either succeed 

or fail. 

. Another area wo examinm concerning test validity (in a sertse),is the extent to which 
a test claims- to el icit ^"hatural'^ languages-language which meets the requirement of 
daily use, Perfofmance on a prof iciency test should be a measUre of J^anguage compe-^ 
tence and not merely ^ measure of t^st-taking ability. T^isks pose^'on l&nguage 
proficiency tests should — as nearly as possible--match the conventions and require- 
ments of ordinary language use. Artific^ial rules and requirements that may serve, thd 
purposes of the test may also serv6 to make the test language unlike \he language of 
everyday communication. . * ^ ^ - 

Finally, we raise a further issue in the evaluation of tests, one which has less to 
do with purely linguistic analysis than the first tvyd, but which depends more on 
research in language acquisition, f Assunnng we know what features constitute impor- 
tant parts or aspects of language., how are these acquired- by a second language 
learjier? If there is a general i zable sequence 6f progress in learh4^g Knglish as. a 
second language, how do we test wliere an individual stands irr this sequence? 

l)liFI:CTIVI: TliST TASKS , , ' " 

S.ome Defects of Item and Task Design " ^ ' 

T^ests that Require Literacy Skills. Several of the oral language prc^ficiency tests 
we reviewed contain subtests that arp explicitly designed to test read ing^*»id writ ing 
abilities. A-or example, one subtest of the Short Test of Linguistic Skills * is ' ' 
designed to assess English listening ability, but the tasks entail (a)^selecting a 
word given or*ally from a written, multiple-choice list of three, words;* (b) 'writing a 
dictated word, phrase, or sentence; and (c) writing certain items which require 
English spelling and waiting ability (e.g,. , print the word animal and underline all 
^ the vowels). The Robstown Oral Language Inventory — although a different kind,, of 
test--also has the same problem of confounding oral proficiency with literacy. T^is 
test requires students to answer questions about wh^n artd wherj^ they use English or 
Spanish (e.g.. What language do you speak at home? Wften you drfeam, what language is 
spokeJV in your dream?). yThese questions are asked orally of younger children, but 
older students (Level 2 of t1ie test) must read them, ^o obviously something more is 
requir.ed than the-ability to understand, and reply to spoken English questions. 

Both tests also contain subtests of Spanish J^roficiency with the same confounding — 
Spanish reading and/or .writ ing ability is required to perform the test task success- 
fully.- ' V 

By making these criticisms, we do not intend to diminish the importance of literacy 
skills in language proficiency; they are merely examples where literacy is included 
as a part of an assessment of something else. Because of the way the tasks are 
designed, the items* are tapping ippre than one performance objective, and respons^ to 
the items depends on the ability to perform in at least two skill areas. 

measuring some different knowledge or skill. ^PerformAnce on a confounde<i^tem or . . 
test task might depend on on^'s skill in what t^ item of task was designed to tpst; 
however^ it might also depend — wholly or in part — on one'^ skill in some different / 
aspect o^f-^ang^age . . 

*A11 tests mentioned in this discussion are further identified in Part 2Vp, where 
comments about specific tests jmay be found under the names of the tests', which are 
arranged in alphabetical order. \. ^ ' 



TaaJ^B that Rmduce-^to a Vocabulary T«st. Many tests include a task where students 
must identify n p)ctui\> corrtfSi)Oiulin>j to a phrase or sentence wl\ i ch luvs . been- ^ i ven 
orally. With pro^r design, Jrtfl^ sort of format^vmtght be einplO)jj^, to tost .whot.her 
students can corlrectly processSirtd understand the structure and meaning of a" spoken 
expression. In'many casO:*, however, students can choose the correct pictAro^ by 
understanding a single crucial word in the stimulus expression.^ In one item of thp 
L anguage Asses sment Battery, the ora|, stimulus^ is The cat and throo faittens ire 
playing. Of tFe tyhree plcUires from which to' choose, only- one contain^ a cat; the 
other two show different objects. The iteoi does not test understanding of the stimu- 
lus sentence as q whole, because by understanding only the word cat, the correct 
picture could be chosen. In another item.frbm' the same test,' the stimulus sentence 
is The puppy is following ' thet -girl . The three picture choices show a girl- with a 
puppy in her arms, a girl with a puppy fol lo^^^ing • her, aad-^girl with a puppy between 
her feet. By understanding the, single word' foil owr, the^^ctWe could be correctly 
identified. Note what might happen had one of the picture^ s|iown a girl following a 
puppy: students would have to- distinguish between a girl following a puppy and a. 
puppy following a girl, and consequently would have to understand the stimulus 
sentience, >itther than just one word: ^ 

The Shutt Primary Language Indicator Test raises very similar issues. On this test 
students identify pictures- corresponding to what the examiner says. Some of the 
items contain ^extended expr,essions or compticated structures , 1 jke what you would get 
if you asked for a vegetable. However, students coulcj' possibly get this item correct 
by recognizing the single word vegetable and identifying the corresj)onding picture. 
ITiis iteih^ like a number of others on the Shutt test, may not necessarily assess 
comprehension of extended expressions, but may just assess vocabulary knowledge. 

To identify test items of this sort,' siiHply'ask, "What kind of knovfledge would be 
required to get' this item right? Do studenrs have to understand the entire expres- 
sion, or is it sufficient to understand one or two words?"' Jf it is enough to 
understand a word or two, then the item cannot claim to solely assess studenti^' 
ability to understand an extended phrase or sentence. ^ . * 

The Crane Oral Dominance Test is another instrument that primarily measures vocabu- 
lary knowledge. The format of this test is unique among those reviewed, since it 
involves a mem6ry task. Eight words are presented orally--f6ur in each language — 
then students recall the eight words. If mor^ Spanish j^rds are recalled, stu(|eftt3 
are coasidered Spanish dominant, and Ukewise for English. The test claims tp assess 
what language students "think" in, but it seems cj^ar that this is predominantly a' 
vocabulary test, because students will have a much better chance of recalling known 
words than unknown ones. 

■ • • / */ 

It i,s relevant to ask Whether or not it is bad for a tesf^to fneasure only vocabulary. 
We are aware that there is much more to language than knov^y^ words. Hie ability to 
understand and properly Use extended expressions is--in some Way — more central to 
language proficiency however, the question of how well yocabulary tests measure 
overall ability remains. We will discuss/this at greater length later, since this 
seems to be a controversial issue. , ^ . - , 

Notions of Lihguiati^c Complexity. Many language proficiency tests require oral 
responses. Frequently these spoken responses are scored according to their. "com- 
plexity.*" Students get more points--and a higher proficiency score— for producing 
"more complex" answers. Categories of linguistic complexity are provided as an aid 
to scoring. A typical hierarchy of categories is that of the Test of Grammatically 
Correct Spanish/English : clause fragment (one point); simple sentence^ (two poiatsj ; 
simple sentence plus--includes compound- subjectSb and predicates (four points)'; com- 
pound sentence (six points*); i:omplex sentence (eigh^t points*); and compound-complex 
sentence (ten points*). ' * ^ 

_ . . _ _ / . ' 

^Personal coimunication from Margarita Lopez de Afestas, Coordinator, Bilingual EducA-- 
tion Project / Las Cruces, New Mexico Public Schools 
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As tin Qverill hierarchy of complexity, this seems reasonable from a linguistic point 
of vlow. In particular, it makes stMisi' to say that thoT number of clauses and how 
they are arranged is one important factor contr ilmtiiu/ to the linguistic comploxity 
of a sentodce. Howevner, there are also some probWw wtth this hierarchy. Chief 
among. them is scoring any /Clause fragment, below any complete sentei^ce. Some clause 
fragments are perfectly natural responses to questdons,,. and require as^much linguis- 
tic knowleSge as a full sentence response.** l^or exaij)le. Playing cards with my . _ 
friends IsMust as nayiral.a reply as.i am fUayiny cards with my friends in response 
to the question What '^e you doing tonight? Furthermore, one must know exactly wheVe 
it is pfermssible to omit "I am" and whore it is not. tf the question had been 
■What's going on tonight?, "I nm" could not have been'omitted. So, although the frag- 
ment response is superficially lesi^ complex than the .complete sentence resixinse, the 
Appropriattl use of fragments may Indicate at least as much English proficiency a^ ■ 
product iori "of full sentences. 

f ' 

For the s^me reason, we should not score compound subject and p^jedicate sentences as 
less complex than compound sentences: John oookod the eggplant and H^rry ate the 
eggplant is no more complex linguistically than John cxyoked, and^Harry ate, the egg- 
plants ^ ( 

Another problem wvth the above scoring procedure is that it is not always easy to 
separate simple- from complex sentences, because it may not be a clear-Cut decision 
whether or not a given sentence contains a subordinate clause. For example, some 
linguists regard all infinitive expressions . as subordinate clause^ and some do not; 
controversy surrounds tliis issue. Sentences that may Contain 'subordinate clauses, ' 
but do not obviously do so, include: John had his pocket picked last night. You 
should come see the new car I bought, A man happy in his work ii? a productive employ- 
ee, and I anticipated John's asking for a rais^. ' v ' * 

Tht Del Rjo Language Screening Test uses another sort of hierarchy to determine 
sentence complexity: (a) sentences with transitive verbs are more complex thah those 
with intransitives-; (b) sentences with more auxiliary verbs are more complex; (c) 
questions are more complex than assertions; (d) negated sentences are more complex' 
than positive ones. From a linguistic point of view, these factors may. indeed con- 
. tribute to complexity, but other important factors are ignored. For example, the 
failure to consider clause structure as contributing to complexity leads this test to 
claim that the followingptwo sentences are approximately equal in complexity (though 
unequal in length): I like ic^ cream, I want to go to school to see my friends. 
On intuitive as well. as linguistic grounds, the latter sentence is much more complex 
than the former. Tests that score students oif complexity of i^esponse seldom consider , 
factors beyond the length or structure of sentences. ' ^ 

The Ott Xest of Oral Language provides a complexity hierarchy based on sentence 
structure. The scoring instructions state explicitly that two responses in a given 
category do not count the same as one response in a higher category. So, a response 
consisting of two prepositional phrases^ counts the same as a one-phrase response; 
likewise, two simple sentences score the saipe as one simple sentence, and therefore 
less than a complex sentence. In some cases, this s;^ring strategy will cause the 
wrong evaluation of students' language ability, because there n\ay be inferential 
relations between tWo independent simple sentences that are as i'eal and ^complex as 
the structural relations between two classes of a complex sentence. For example, the 
statement J£hn went to the store because he wanted to buy some bread expresses a 
causal relat^nship between two clauses. But the two sentences, John went to the 
. store. ' He wanted to buy some bread, imply the s^me causal relationship. And merely 
represent the use of one linguistic mechanism rather than another to convey the 
information. TTiere is no principled reason to regard the second example as less 
complex than the first. ^ ^ 



Tasks that Are Uetlcient in Principle ^ - 

• * , 

The previoi|H examples are cases oT faulty items or ta^k design which caused particu-- 
/ lar purts^f tesf^s to falh to reflect the structure or organization of language. 
V'Hiere are, however, some ^t est t>asks which**-by ,thoir ntiture--are of- limited useful- 
ness in assessing overall language proficiency. ' , 

Mimicry. vSeveral of the test5^ we reviewed use an oral mimicry task* basically, the 
^task requires students to repeat exactly words, phrAses, or sentences spoken by a 
test udininist latuf . Tlie obvious probl'em with mimiciy is that it does not^orrespond 
to any*' skil r noctJSsUry for dai^y use of language for communication. In the tests we 
reviewed, the mimicry task was qsed either as a means fo» eliciting a speech sample 
on wlvich to asSoss pronunciation*''or as a means of asVossing ability to process, 
•remember, or compreliend sentences. 

*I1ie miiAicry task cannot provide- a direct measure of comprehension, sinc^.we oan 
imitate- -more or less prec i sely-/;iuiy number of things that wo^cannot understtiird, 
ThQ ability to mimic speech well is^^^n^ tjie same as the ability to process and com- 
prehend language; if it were, parrots fould be proficient English speakers* 

Tests that rely on pure mimicry to assess sentence-processing ability are relying on 
a connection betwe<?n understanding and memory. In psychological exp,erimqnts , it has 
been shown that a person can perform better at remembering a se<iuence of elements ^ 
when those elements are organized into a single, larger unit. It is easierto rememr 
her a five-letter word than a meaningles^s sequence of five, letters, and easier to 
remember a seven-word sentence than to remember those s^me seven words in scrambled 
order^, According to this principle, students should perform", bet ter ar reifteftibering 
and repeating linglish sentences if they are ui\derstood as sentences rather than as 
meaningless^ groups of words or--worse yet — as meaningless sequences of(:Bpunds. Two^ 
sections of the I)e.l Ri o La nguage Screening Test apparen^tly rely on this principle* 
This test states v\\vit *^ , .a chi Id usual ly cannot repeat a syntactically complex 
sentence wliich is beyond his linguistic competence, this is probably too strong a 
claim, but illustrates the test makers' adherence to the above principle. 

There are three proble;ttS wi^h this sort of test: (a) It is possible to mimic exactly 
sentences not understood ot not understood well, ivwd this factor cannot be ruled out 
in any particular student's performance, l-urthermore, one student may be a better 
mimic than another and so will do better on this sort of- test, even if both' students 
are, in fact, etjual in language ability* (b) Research has not estal^lished whether, 
or how much, partial knowledge of a system aids a pers5n in remembering units of that 
s>^tem. Such research is required before we can inf^r tha,t a student who knows a 
little English has a better chance of remembering ^linglish sentences than -a student- 
who ^does not know as much Hnglish. This is a reasonable assumption, b"t should be 
carefi^lly investigated before it is used as tihe basis for proficiency tests. (c) 
Mimicry tests, such as the Del Rio and the MAT-SEA-CAL bral Prof icien^y tests, 
require exact mimicry* Paraphrase is counted wrong (MAT-SEA-CAL' Examiner 's Handbook) 
Likewise, one section of the Nortljwestern Syntax Screening fe'^t counts a paraphrase 
wrong if it has the effect of altering or eliminating the particular syntacti^c 
element that ^the test item intended to obtain. But if these tests intend tO as.sess' 
sentence processing^^or comprehension, there is no reason to score close paraphfases 
wrong. Students who make a small change in what is heard^ leaving meaning intact^ 
have probably understood the stimulus sentence, in fact, making a meaning-preserving 
.change perhaps provides better evidence of underst)anding than ef,act mimicry* For *' 
example, a student who hears He looked up the address Snd repeats He leaked the 

\ <: ' ' ■ 

*Test3 employing this stfat^gy are the Harris Articulation Test / the Ott Test of 
Ox;al Language , the,'' Skoczylas Phonemic Unit Produc.tion Test , sections of the Milwaukee 
ESL Achievement Test^ , the Language Assessment Scales / and the MAT-SEArCAL Oral Pro- 
ficiency Test , , ^ ^ - 
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Address up probably has not m i spla^od a word, but most likely applied the rules of 
l.iiijlish to i>roduce a Kraiumnt i ca 1 , synonymous version of the stimulus sentemo, It is 
ovon po5siblo/jMt i^iich paraph ra!i#^ responses are more likely in the dominant laiiguaKo 
than In the s\pcondaty one. since *;tudents are Hiore likely to contr61 ^ucU Jiynanymows,. 
styUstl.c variants In the betterAnown lanKuaye. Tests that requi^'e exact mimicry 
pr.edicT the reverse: in the donianant lanKuajie. a person should produce f^wer varia- 
tions from .exact , word-t(jr-word/repet it ion.^, . 

Passive Comprehension. ^ In trylOK to det9rmin"C whether a child understands a particu- 
lar lingitistic form or structi^e, a test. can either attempt' to^et chiUhnvn to pro- , 
du^tJ. the structure in appn)pr j^ate ci rcumstar^ces, or it can attempt to get them to act 
appropriately ih "response ^o jlioar inn ^'^P structure/ With the l^atter strategy, it is 
usually very difficult to b/^ /sure the childi*pn control tlfP part icu lar structure fn 
qiu>stion, even when respondi^fi^ ai>propriately . , I'or example, in one item of the Li\\\- 
gu nge ^Asse^sment Scales , stiidents mus't choose the correct picture in resiH)nse to the 
passive sentence The forks Ire hold by bcith ohildren. ^ OnLy one of the three^ picture^, 
shows two chi4dreu wi th ,foij(ks , so it is possible to get this item right b)? simply 
combining the word? *ot7i iiM forks. In any one case, we cannot be sure tlvat a cor- 
rect response to this iten|[ i ndicates control of the linglish passive construction.* 
If we wish to te^t fgr coi/trol of some specific structure or expression of l-nglish 
tor any other language). It is better to try. to get tlie structure actually produced. 
Ih may woll be unwarrant(*l to infer that a part icular structure is controlled merely 
because the response is ^pproj^riate. 

/ ' ■ - . 

Interring Lack of ControU from Lack of Pertormatyae. Some of the scpring schemes 
used on tests occasionally run at1)ul of the problem that lack of knowledge cannot 
be inferred from one or a few instances of lack of performance. In the Test of 
C ^rammat icall y Correct Sp;;inish/l£ngl ish , for example, points are awarded according to 
the part fcular form students eject to use (e.g., person-marking, plurals, contrac- 
tions, prepositions). I'ailure to use the scored items does not, however, indicate 
that they are not known or cannot be used by the student.s. A randpm factor is intro- 
duced into the final test score because results depend, in part, on what students 
happen to say on one occasion. .Similarly, the Ott Test of Oral Language awards more 
points for production of a compound or complex sentence than a simple sentence, and 
more points for a simple sentence than a phrase. Mowevfer, students might produce 
perfectly natural, correct answers to the test stimuli without ever producing a ^ 
complex sentence. (Indeed, we know of nx>. .^nglish quest ion 'whose only natural answer 
is a full, complQx sentence). It is not legitimate to conclude that students dannot 
produce complex sentences, when they have not been asked a question that naturally 
requires a- complex sentence answer. While the HI Paso Oral Language Dominance 
Measure is attractive as a dominance or prof ic iency test , it is somewhat less useful 
as a diagnostic tool. 'Ihis test induces a v*ariety of linglish syntactic and morpho- 
logical structures (though the test materials do not specify exa.ctl/ wh^t structure 
ea^h item is intended to elicit). In scor^in^ responses to these items, the test 
avoids the erroneous scoring strategy, previously cri^ticized by allpwing any gram- 
matical and appropriate response as a correj^t answer. Although generally a good 
scoring strategy, it produces prcfl^lems when we attempt to determine whether a child 
controls particular English structures, since appropriate answcirs are possible that 
do not contain the particular struc-^wres that the test intends to elicit. We cannot 
assume that failure to produce those structures means no control of them. Before 
tKe VA Paso test could be used with confidence for diagnostic purposes, test items 
would have to be designed much more carefully, to focus on specific linguistic -struc- 
tures or expressions. ^ * 

The test materials do not claim that this item assesses control of passive construe- 
' tions; 10 fSct they never specify what structure is testdd by any item. However we 
may hssume that a passive stimulus sentence is intended to test control of passive 
construct ions. ^ 
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SBXt-Rm^tt9d Data. T\\e authors of the Spanish-English Dominance Assessment Test 
state oxpluNitVy that an assumption inulovlying the tOsf Is that children are able to 
report accurateit on what language they speak in particular social situations (Man- 
ual) • Under thi^ assumption, it is justifiable simply to ask children what language 
they speak in given situations. Part of the Spayiish-English Dominance Assessment ' 
Test \s organized on this format, and a niunber o^ other tests we reviewed depend, 
wholly or in' part, on the validity of self-reported data.* These are tests that we, 
term *"sociol ingui Stic questionnaire^, which seek to determine language proficiency 
or (more joftcn) language dominance by gathering^socib logical information about^per- 
soiiftTSlanguage use, rather than attem|)t|ing to determine language ability directly 
througli linguistic tasks. For a giveri /language, these tests might ask: Who do you 
speak the language, to? Mho speaks it to you? Do various "relatives and friends speak 
the language? Where do you speak the lan^age? Do you, your family ^ or your fribnds 
listen to music or radio, watch movies or TV, or read newspapers or magazines in the 
language? 

There are four problems with the socio linguistic test format. First, tests that ask 
children whetheiv they speak English or some other language in particular social situ- 
ations assvume that all the children will be consciously aware that- they control two 
separate and distinct communication systems; but some young children who may be awar#- 
that they speak differently to different people and in different situations, may not 
-be explicitly aware of the difference between the two systems!, or of the names of the 
* two systems. So, some young childreif might speak English in situations where it is 
socially appropriate to do so, but might not understand what is meant by such a ques- 
tion. (We will discuss this point further in connection with a different .issue. ) 

Second, a person's honest beliefs about where, to whom, how much, and in what social 
situations a given language is spoken may rt9t match actual practice. There is con- 
siderable sociolinguistic research literature that contradicts the assumption .that 
^ children can accurately reix)rt their language use. These studies call into question 

^ the results of all the sociolinguistic tests we reviewed. ' 

Third, children might knowingly give false answers to questions about tbeir language, 
for a variety of reasons. Children might report what they think should be the case 
or what they want the examiner oj school authorities to believe, rather than what is 
factual. Tliis problem may tend to arise especially in situations wher^ use of k 
given language is stigmatized (e.g., where it serves to idei^ify a minority popula- 
• , tion of lower socioeconomic status in a given geographical area). In addition, there 
is always a possibility that older children, wh6 may know that their answers will 
affect their placement in ESL or bilingual programs, may attempt to give answers that 
place them where they want to be. Two of the tests we. reviewed, the Los Nietos School 
District Language Dominance Survey and the Moreno Quick Language Assessment Inven - 
tory , contain questions about language use wluch are to be answered by the students* 
parents. Obviously, the above criticisms do not wholly apply to these tests; how^- 
ever, it should.be noted that parents • responses--for a variety of reasons--rtiay 
reflect particular expectations, opinions, or biases which could interfere with, 
accurate reporting. 

Fourth, certain socioiinguistic questions might not even have a clear and unequivocal 
answer. How will, children determine in what language their mother speaks to them, 
.when she may speak different languages^ under different circumstances or tend to 



*Test^ we revJfewed. that make use of this format (wholly or partially) ate the Brooks 
County Language Usage Inventory , the Hayward Language Dominance i;ndicator , the Lan- 
guage Dominance Crit*eria , the LAn^uage Dominance Survey , the Los NlStos Language 
Dominance Surveij , the Marysville Test of Language Dominance , the Horeno Qaick Lan- 
guage Assessment Inventory , the Robs town Oral Language Inv^ntgry , the Skoczylas 
Home Bilingual Ukage Estimtte , and the Spanish- English Dominance Assessment Test . 



code-swttch (to speak both languages alternatively in the course,of a single convey- 
sattoji or oven within a single Sentence) t _ ' 

^Jn connection with tests that include both a "sociol inguistic section and a direct ^ 
lA^asure of linguistic perfortnance, one further problem exist^ in the comparison of ' 
these*two very different types of information. It is not. at all clear how, or even* 
swh^ther," they can bfe compared. Some tests derive a total score /or the two separate 
sections,- and theli simply add them to obtain an ovtrall dominance score. Iliis is 
something like addijig ai^ples and oranges, without some research on how the two typ«s^ 
of questions are to be weighted. Foi^ exaniple, in determining language dominance, tTie 
scoring procedure for the Brooks County Language Us kge . Inventory makes the implicit 
prediction that being able to. identify a picture of a feather as a pluma counts 
exactly as much as Claiming to use Spanish in the home. It is difficult to see any 
basis for this claim^ This test and the HaVward Laivguage Dominance Indicator both 
add the/"scores of sociolinguistic secftions to those of direct performance sections. 
Two other tests, the Language Dopiinarice Survey and th| Language Dominance Criteria , 
are more careful in at least' refusing to make any direct comparison of the results of 
sociolinguistic and language pe.rfonnance sections. ' ^ . 

I 

DO SPECIFIC THST TASKS DEMONSTRATE OVERALL LANGUAGE SKILL? ' , - 

A number of test tasks do measure what they intend to. It is relatively easy to. 
construct a test that measures vocabulary knowledge or correct pronunciation, and 
very easy to construct a test that measures the number of words or sentences children 
utter ia response to a given stimulus. However, the skills measured by these par- 
ticular tasks may fail to provide a valid ind^x of overall language ability. 

The Value of Vocabulary Tests , 

The widespread appeal of vocabulary tests probably stems from the facts that they are 
easy to'construct and score, and that they assess one "of the most highly visible, 
straightforward aspects of language abil ity~-knowledge of word raeahings. Neverthe- 
less, from a linguistic point of view, there are possible problems with vocabulary 
tests as measures of overall language skill, since there is much more to knowing a 
language than knowing words in that language. Vocabulary, knowledge is highly dtstach- 
able from other language skills. Memorizing a thousand common words of a language 
would probably enable students to do rather well on simple vocabulary tests, but more 
immediately central to proficiency is the ability to form normal, grammatical sen- 
tences and to use appropriate expressions under appropriate circumstances. By simple 
memorization, vocabulary knowledge in a second language can be increased without 
necessarily increasing proficiency in using the language for communication. 

In defense of vocabulary ^tests, it cduld be argued that second language learners do 
not usually start out *by 'memorizing a thousand common words; rather, they b^ in by^ 
learning a whole array of language skills— including vocabulary— and ffiaf a partTcu^ 
lar degree of vocabulary knowledge usually indicates a corresponding degree of pro- 
ficiency in pther language skills. Despite this probability, tests using vocabulary 
knowledge as an index of overall proficiency are of limited value. Vocabulary is 
more subject to vatiation than. any other aspect of language. It varies among 
speakers of. different ages, from different regions, ^nd with different cultural 
backgrounds. It is also more subject to change over time. 

Constructing vocabulary tests that account for all this variability is difficult. 
This is reflected by the fact that vocabulary tests almost . always elicit content 
'words (predominantly nouns, sometimes verbs, occasionally adjectives), and it is 
content words that are most subject to cultural, regional, and temporal variation. 
Vocabulary tests, almost never elicit function words (prepositions, conjunctions, 
pronouns), which are more intimately associated with the grammar of a language. For 
example, the vocabulary section of the Pictorial Test of Bilingual ism and Language 
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Development elicits nouns exclusively. Hifteon out of 18 items on one test of ^evel 
3 of the Lanjjuage Assestniont Battery are nouns, and the remainin>i throe are adjoc- 
. lives. In one •vocatulary section of the Joiucs Language Uominancc , Te^t , ib of, JO 
/ Items arc iiouns, while four- are present participles describing act ions ( tai/cing, 
eating). * ■ 
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Ba<;ed on the preitiist; that if children do not know the coimnon wor^fi^ of a language, 
they will not know thejaror ones, vocaliillvry teit constructors often try to smiiple a 
••core" vocabulary of common words. To identify a core vocabulary, test makers some- 
^ times depend on wor^ frequency lists; the Language Assess mfei^t Scales, for example, 
makes use of the Thorndike and l^rg« word .frequency list,^hich was compiledVin 1952 
^ from a survey of childrtn*s reading materials. It is important to note that Vocabu- 
lary tests that are based on such word frequency lists can only be -«s good as the 
lists tlVemselves. As (if) the lists become dated, they muy not accurately reflect 
children's current «?poken language, which is what oral proficiency tests must assess. 
Any differences between how children s]X)ke in 1952 and |iow\they speak today would 
work against^this kind of vocabulary test as an adequate measure of children's 
present oral linglish ability. 

In addition, it is difficult, or eveit dangerous, to claim that any particular core 
constitutes an adequate vocabulary Scunpling for all children. Vocabulary is that 
part of language wli ich--along with its other variables — is most subject to individual 
variation, most dependent on what experiences the individual happens to have had. 
Since the words a child knows will always depend, to some extent, on idiosyncrasies 
of the child's hi$t:oi:y, poor performance on a particular set of ''core" words does not 
mean lack of general vocabulary knowledge (and thus overall language proficiency). 

Some vocabulary tests do not claim to provide an overall measure of vocabulary knowl- 
edge., but merely to provide a oomparativG vocabulary measure for two languages* This 
is the claim made by the Spanish-Mngl ish Dominance Assessment Test and the Pictorial 
Test o f Bilingualism and Language Dominance . These tests ejlicit names of objfects ^for 
actions) in Spanish and linglish. If more Spanish than English words are produced, 
this is taken to indicate Spanish dominance, and vice versa^. Tliis format avoids, the 
previous objection that if children do not know a word because they have never 
encountered the object it names, then that word counts neither for Spanish nor English 
dominance. Yhis kind of test, however, can run into the problem that vocabulary is 
often culturally oriented. For exajnple, a bilingual Mexican American adult reports 
that most of the Spanish words he know.^ are associated with cooking, while most of 
the words associated with cars, auto parts, etc., are English--ref lecting details of 
his* particular background. Unless cultural domain is taken into account, vocabulary 
tests run a risk of being seriously biased toward the language associated with the 
domain they represent. Tlie Spanish- English D(^minance Assessment Test contains a 
vocabulajry test focusing on the kitchen and the yard; this would yield biased results 
for children who Speak Spanish in the context df the home, but speak English away' 
from home. Such children would naturally know more kitchen and yard words in Span- 
ish-, yet they might know more English words i;i other domains, and in fact be as pro- 
ficient in speaking English as Spanish.* 

The Hayward Language' Dominance Indicator allows more leeway, eliciting words associ- ' 
ated with the kitchen, street, store, school, and doctor's office. This is a fairly 
wide range of domains, but the test authors do not claim to have checked whether 
bilingual children in their school district tpnd to speak- Engl ish or Spanish in each 
of them. (There is very Little explanation or rationale provided with the Hayward 
test. It is possible that the authors did attempt to balance domains in which Span- 
ish is likely to be used with those in which English is more likely.) The Pictorial 
' Test of Bilingualism and Language Dominance was apparently more carefully constructed. 
Using a test group of Mexican American migrant children in Texas, the authors 
included only items known in English and Spanish by at least 50 peiKcent of the chil- 
dren, and for every item known by more children in Spanish than in English there was 
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an item known by more children in Hngllsh than in Spanish. This seems to be a clever 
and offoctive way to balance a voeabuhlry test for Vultiiral domains, llowcvor, this 
test would have to be reconstructed and recalibrated for use with other cultural 
(e.g., Cuban children in Miami) or language groups (e.g., Italian or Cliinese chil- 
dren) • ' 

Our basic criticism of vocabulary tests as measures of language proficiency is that - 
a child who is proficient in a language will certainly know many words, but a child 
who is not proficient may still know a (good number of words. Simply knowing words* 
does^ not^uarantee a functional knowledge of the structure of a la*nguage and conven- 
tions>^fcrr its use, Ilius, if a vocabulary test errs, it will be more likely to err in 
overestimating the pr6ficiency ^f a child who, for example, speaks English poorly. 
iTiis is exactly the error one does not- wish to make, because* it has the effect of 
denying special eduCiational help to some children wlio may need it. 

Hie Value of Phonology or Pronunciation Tests 

Phnnolmyy and pronunciat i(5n tests do not assess overall linguistic competence, and, 
as fai^s we know, no one has claimed that phonology/pronunciation tests provide 
adequate measures of overall language proficiency. Rather, these tests claim to 
assess only one component of oral Icfnguage skill. Many tests are constructed fairly 
carefully on linguistic principles to test^the ability to produce or distinguish 
phonological contrasts characteristic of a given language. Tests of English phonol- 
ogy are Frequent ly de.^igned to include English contra>^«. and sound tiombinations which 
do not occur in Spanish, and therefore are often difticurt for Spanish speaker^ 
learning English, llie L anguage Assess m ent Battery requires children to distinguish 
between y versus j, sh versus ch, th [}S] (as in the) versus th [Q] (as in three), 
among others. T\\o Skoczylas Phonemic Unit Production Test grades children on pronun-- 
(;iation of th in that, sh in she, ked [kt] in liked, ng in running, a in fat, etc. 
Other tests (e.g.., the Test of Grammatically Correct Spanish/English ) elicit chil- 
dren's speech and grade it for something they vaguely term "correct*' pronunciation. 
Apparently, this means how closely children sound like native s^peakers in the impres- 
sion of the scorer. 

If such tests measure only phonology or pronunciation and warrant no inferences 
about overall language skill, then their value depends* on whether or not it is useful 
or important to assess children's phonological knowledge or pronunciation skills per 
se, and whether test instruments are required to make this assessment. For educa- 
tional purposes, it is certainly necessary to determine whether students' pronuncia- 
tion of English allows them to be understood. However, any teacher who speaks 
English can make this determination without employing a sophisticated phonology test. 
Such tests may provide more detailed analyses in assessing pronunciation of certain 
isOunds, but there is some doubt whether this kind of analysis is really useful in 
assessing English ability, since any one mispronunciation is not very likely to 
impede communication. A child who says A chip with tall masts floated in on the tide 
will not be misunderstood. It is only when mispronunciation becomes global and 
severe that communication is threatened, and a child's ability to get along in an 
Engl ish-speaKing classroom is placed in jeopardy. 

The detailed phonological diagnosis some tests make of students' speech production or 
perception might provide information that a teacher can use to help students with 
specific pronunciation problems. If the test shows that .a Vietnamese child does not 
produce word- final consonants in English speech, then the teacher can focus on that 
particular problem. The Ott Test of Oral Language explicitly claims to provide such 
diagnostic input to English teaching. This sort of information might indeed be one 
useful feature of phonology /pronunciation tests, but past a certain point, there is a 
question of how much instructional time one would wish to spend *! phonology. If 
pronunciation is understandabl e^ then there are probably more important aspects of 
language to. work on. It will be difficult, time consuming, frustrating, and probably 
unnecessary for students t6 try to produce native-sounding pronunciation. 



It is cortainlX) ne^feary to determine whether pronunciation can be understood; how- 
ever, it Is doubtful whether the detailed analysis provided by these kinds of tests 
is necessary to make this gross judgment. Furthermore, it is doubtful whether one 
would want to use the detailed analysis 'iri making finer-grained judgment^ abovit 
linguistic ability. Detailed analysis might help teachers focus on a particular or 
acute pronunci'at ion problem, but this, too, might be ^ mixed blessing if it over- 
emphasizes pronunciation and neglects other aspects of language* 

Measures of Linguistic Creativity . ^^^^ 

Some test items yTequire students to exercise some degre^>^^l44nguistic imagination by 
describing soraef|hing or answering open-ended questions./ This i^ not 61itirfely unfair 
ort language pro%l,ciency tests. Since these demands are treasonably natural linguistic 
skills which students might have to use outside the testing situation. But, all «uch. 
items--to some degree--measure a skill beyond simple language knowledge in that tf^^ey 
also test creativity, imagination, and willingness to extrapolate from known facts, 
in the. context of the testing situation. Whether thesfe linguistic ''creativity'' items 
really assess language proficiency, or go beyond it, depends on, how much extrapola- 
tion is demanded by the item and on how the resiAts are ,^scored. 

Before we discuss particular tests that make greateig. or iesser demands on a child's 
imagination, we will present one argument for why it migHt be dangerous to place 
too heavy an emphasis on linguistic creativity as a measure of language ability. 
There is well-known (if anecdotal) evidence for two distinct types of second language 
learners: Risk- takers and conservatives . Risk-takers are readily willing to speak 
the second language and to make any number of errors, as long as they can make them- 
selves understood. Conservatives, on the other hand, are much less ready to speak in 
the second* language unless they are reasonably sure that what they are going- to say 
Will be gramipatically correct. Furthermore--and most* important — this distinction 
does not necessarily correlate with how well a person speaks the second language. 
Conservative language learners may be relatively proficient in the language, and 
still be unwilling to speak as freely or to say as much as a risk-taker who may be 
iess proficient. Without claiming that every person falls in one of these categories, 
it is clear that if the distinction is at all real, it may affect the results of any 
test task that requires language production; but, it seems likely that it will have 
more effect on tasks involving linguis^jlc creativity. A risk-taker is more likely to' 
be willing to respond to such a task, fifitd will probably produce more speech, and 
extrapolate farther from simple descriptions of known facts, than a conservative with 
the same degree of language knowledge. If ^performance is scored •according to the 
grammaticyil correctness of the response, then this would tend to^favor the cons'erva- 
tives. If it is scored according to the amount of speech produced or the degree of 
imagination displayed, then it favors the risk-taker. Either way, the creativity 
task malces it possible to confuse language ability with how willing a person is to 
take risks in speaking a second language. 
;\ 

To con found matters even more, systematic cultural differences may have an effect on 
this task. For cultural reasons having nothing to do with relative language profi- 
ciency, children from some cultural or national backgrounds may be reluctant to 
respond at. length, while others from different backgrounds may be more verbally 
assertive in the same situation. Additionally, cultural background and/ or personal- 
ity of the test administrator may tend to encourage or inhibit children taking this 
sort of test. Thus,, cultural differences and differences in individual style can 
play a confounding role in tasks attempting to measure language creativity or imagi- 
nation. ' 

Tests thAt we Reviewed required linguistic creafltivity or iiAaginatiori to varying 
degrees. Some tests merely^ contained a few items intended to make a child extrapo- 
late from known facts ot pictures; at tK.? extreme, some tests -were entirely composed 
of questions intended to extract connected stories which were then graded for 
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creativitjy, organization, "abstractness," etc. An example of the fir^it type is thd 
••Picture '.(;on<>rating Rcsponst^" subtost of the Case Tost for Non- Hnglish Hpeakiiig Stu- 
dents « O^e sWies of pictures shows saws and 'boards, and ends with a picture of a , 
hand ho Idling a board. One question as^s. Who do you ttiink the person may be in 
[this p'icturej? and ffhy do you^think it should go in [this picture]? It is not clear 
from the fest materials how such items are to be scored--for the grammatical it y of 
the answet, its content, br both. The Ilyin Oral Interview contains some similar 
items, an(| similar puzzles for the scorer. 

A test thjit relies much. more heavily on li^|^istic creativity is exempl ified'^b^ one 
j» part of the Pictorial Test of Bilingual ism and Language Dominance . A picture is 
ehown to a child who is askitd to tell a story about it. After th® child responds 
with a stok-y (or if he fails to do so) , four m^re explicit prob^u est ions are asked 
about the picture. Tins procedure is followed for English and Spbnish, wi,th the 
same pictures and probe questions being used for both languages'. The child's 
responses are then scored for grammatical ity and "completeness." Grammatical, com- 
k plete sentences earn t^he best score;- ungrammaticalities and phrases are next, and 
word lists naminji the Objects in the picture are scored lowest. This is not 
entirely a creativity test, because grammaticality and other formal properties of 
the child's answers are considered in scoring. Performance, and thus score, can be 
affected by whether the child is interested enough by the picture to think up a 
story about it--d factor not directly related to language prof iciency. This "inter- 
est" factor will become much more important in the next t*wo tests discussed, where ^ 
straightforward description earns a lower score than flights of creative fancy, and 
the grammaticality of the child's response is apparently not seriously considered 
in judging proficiency. 

In one section of the Oral Language Evaluation , the examiner shows the' child a pic- 
ture, reads a brief description of it, and then instructs the child to telJ about 
the picture. Performance is scored according to six categories which represent the 
authors' beliefs about how language develops (Teacher's Manual), but which do not 
appear to reflect the findings of any recognized research in first or second language 
acquisition. In effect, the test seems intended to elicit a short story, since a 
simple description of the picture earns a much loWer score than an abstract story 
containing, details, of mood and characters' emotional responses (Teacher's Manual). 
A straightforward description is taken to mean that a child "needs some aspect of 
language training [and] is probably not ready for reacting." As this test is designed, 
such conclusions are entirely unwarranted. There may be man/ reasons why ia child 
might not produce an abstract story. One could be that it might be very unclear to 
the child what is being ask^d when subsequently instructed to "tell about the pic- 
ture" which has already been described by the examiner. There is no effort to 
explain what kind of response is desired, nor could there be: What could the child 

make of such words as mood and 'emttcmti-i?^atlonS'i So, it seems unlikely that the 

child will even be able to clearly understand the task posed. 

This section 6f the Oral Language Evaluation allegedly»assesses the need for oral 
language training and reading readiness; however, the test really confuses proficient 
language performance with a Certain derivative language-based skill— the ability to 
compose fiction. Some people are *good at composing fiction and some are not, but 
this does not necessarily say anything about their ability to use English under 
ordinary circumstanc'es . 

Itost of these criticisms of the Oral Language Evalua,tion also apply to the Language 
Facility Test . Both tests set up a series of categories as a supposed hierarchy of 
language development, unrelated to any of the considerable body of research on lan- 
guage' development . In bo^li tests, the lower categ\3ries are related to the form of 
the language used, the linguistic elements that ocdur, and the organization among 
them;' the higher categories contain judgments about the completeness, implications, 
organization, or abstractness of the story. The lower categories seem to evaluate 
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something very, different from the higher ones, because judgments at the lower levels 
are based on the foritj of the lanKuage used, while the higher levpls depend on the 
.literary properties of the «tory the child tells. In scoring Jthe Language Faclljity 
instructions are given tp ignore vocabulary, grammar, and pronunciatjion. 
Ahigh scoring story could be ^'grossly uhgrainnatical and firomja person not fami<mar \ 
with the correct names for some elements iyf the pi.ctures" (Test Administrator* s iMan- 
ual).. This scoring strategy makes ue wonder just "what ia being tested here, sinice a 
person imight not control enough linglish to function in daily life, , and yet be ra^ed 
in the very top category of this test. • - . 

Counting Linguistic Elements 

Some tests feature a scoring strategy wherein speech^-anything from lists of woris 
to connected descriptions or discourses--is elicited from a child, and linguist!: 
elements contained in this speech sample are counted. Whether sentences, phrasefe,* 
words, or syllables are counted, and whether the final score is represented as a 
simple total, or as an average of one sort of element with respect to another (e.g., 
average number of words per sentence), the intent pf such strategies is usually fo 
claim that the inclusion of more elements indicates greater proficiency, and that the 
quantity of language^produced is* a good index of overall ability. i 

i. ' • 

Tlie general problem with this claim is that th^ total amount of speech a child pro- 
duces on one occasion, in response to a particular set of stimuli, does not neces- 
sarily tell us what the child knows about language or is capable of producing. There 
are various reasons why children might not, on particular occasions, produce a lot 
of speech: they might not know much English (or whatever language is being 

tested); (b) they might not be interested or motivated by the test items to spe^k; 
(c) they might not be linguistic risk- takers; (d) they might not have understood that 
they were expected to produce an extensive amount of speech; and/or (e) they may . 
think that simply answering or responding concisely and to the point is all tUat Is 
required. Tests that score performance by counting linguistic elements tend to 
assume that the only possible reason for children not to say much is because they do 
not know much of the language, but the o\her reasons are real possibilities and tend 
to vitiate the results of such tests. 

The Basid Inventory of Natural Language (BINL) i6 scored almost entirely by counting 
linguistic elements the chil'^ produces. Various sorts of elements are counted and 
reported as independent categories in each child's "oral language profile.'' We will 
consider in some detail the^ two categories of "average level of complexity" and 
"fluency." 

In the BINL , the average complexity level is found by counting complete and partial 
sentences, modifiers, phrases, and clauses^ calculating a'weight:ed total of all these 
elements, and dividing by the total number of sentences. This score is sup^sed to 
reflect the average complexity of the sentences the child produced, but there are 
several problems with this strategy. First, there are no accessible, objective, and 
reliable criteria for deciding what a clause is, what a phrase is, or what consti-^ 
tutes "modification." This sort of decision may appear simple, especially concerning 
the most common, clear-cut cases in each category, but everyday language makes con- 
stant use of a wide range of grammatical structures which challenge analysis. This 
fact is bound to complicate thescoring of a test such as the BINL and to limit its 
relia:bility. The difficulty with scoring on the BINL is further increased by the 
problem of ellipsis, although the authors of the test intend for appropriate ellipsis 
to be allowed (Instructions Manual). For example, in a question and answer sequence 
such as 

Where is the cat in this picture? 
In the tree. 

the answer would be intended to count as a complete sentence,, and not as a preposi- 
tional phrase. Looking only at the language produced by the child being t 3s ted. 
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the scorer of the BIN! has qo way to distinguish acceptably elliptical utterances 
such as the above, which are to bt* counted as "complete sentences/' from .'Virtial 
sentences" or "phrasos," 

Another problehi, with this scoring strategy is that it assumes that all linguistic 
phrases, all cliusjes, and all forms of modification are equal ly complex. A moment's 
reflection will show that this is not true. The scoring procedure is apparently hot' 
even intended' to consider whether a child's responses are appropriate, Iftternally 
relatefd, or eve« grammatical ♦ Tl^e test materials do not say that only 'grammatical 
sentences should be counted as "complete sentences." In. fact, certain unRrammati<^ali- 
ties are acceptable (Instructions Manual)/ but it i,s not clear Whether the authors ^ 
intend to- accept all ^igrammaticalities. A more subtle problem con<;ems the coherence 
or relatetiness of" the response, because a series of unrelated sentences .would be 
scored as high as a coherent response. For >xample, the following ^wo /responses would 
be scored as appro xinvately equivalent performance, but the first is lobviously a more 
sensible use of linglish: ' 1 

• John went to the store. He bought some bread. Then came /loi^. 

n The cat is on the jnat. My ear is purple. Beavers live in Canada. 

Another categpry in the BINL language profile is thd "fluency" score--the total number 
of words produced. Here a chi Id can get a higher score fqr responses that are over- 
explicit to a degree that is linguistically unnatural. In the Instructions Manual, 
the fest authors point out that the natural answer to the question Where ajre the toys? 
is On the tabl^, not The toys are on the table. In fact, in most circumstances it 
would be unnaturai--'unchfiracteristic of the ordinary conversation of native English 
speakers--to produce the complete sentence answer* Yet, chi\4ren will get a higher 
"fluency" score on the BINL for producing this conversationally unnatural response. 

The Oral language Dominance/Mea^ure (HI Paso Public Schools) assesses English or 
Spanish proficiet|cy as a function of two variables--total number of grammatical and 
appropriate responses to the test items and total number of words produced^ Tlie first 
of tUfese is linguistically sensible as a measui*e of proficiency,' but the second seems 
dubious. Tlie Examiner's Manual reports tl\at the test makers' own resfearch ha,s found 
the two factors to. predict language ability, but this research is not described, and 
no* bibliographical references are given. 



latically Correct Epgl ish/S panish (Las Cruces School District) scores 
't, by counting the number of words and syllables produced, and by 



The Test of Gramma tj 
responses, in pari 

evaluating the uncommonness of the words used (i.e., whether they appear on a li'st of 
the statistically most common English words). Thus, this test partly evaluates 
responses according to whether long words and/ or uncommon words are used. In effect, 
this scoring procedure focuses on the content Words used by the child, since the 
function words of English are characteristically short and frequent in occurrence. . 

The Language Dominance Indi^cator Test (Haywar^d Unified School District) Contains 
two parts. One part asks five questions \ibout the use of Englph or another language 
{When your father, speak^ to you, what le^nguage does he use?), nnd one point is scored 
for English each time the child claims to use it in a particular social si^tuation. 
Five English points are possible, the other part of the test is scored by counting 
tnfe number of nouns produced; the child is asked to name objects found in the kitchen 
andvin four other locations. One point is scored for English for every object named 
in Hnglish. Asi^de from the problems involved in measuring language proficiency by 
simply counting words, this scoring scheme implicitly m^es. the unsupported and 
counter-intuitive claim: determining^ if children know tlie Engl is/h word stove as 
something found in the kitchen tells us exactly as much about theii^ English profi- 
ciency as determining that the father speaks in English. While jt i^ fairly clear 
that these are not equivalent indices of language ability, we have^ no idea how they 
should be cpmpared, nor whether they should even.be compa^^ed. ^ 
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LINGUISTICALLY ARTIFICIAL TEST TASKS 

Generally speakiAg, a test of language proficiency should assess familiarity or fifcil- 
ity with the rules of a ^language and tlje conventions that govern its use as vl means of 
communication. In testing language p^pficieticy , we should try to avoid assigning 
requirements beyond those imposed by the ordinary convent ionalyn^e of language. Such 
extra requirements--artifacts of the testing situatioh--risk getting in the way of 
what the'test is really trying to. measure- -overall an guage skill. Of course, all 
tests will be somewhat artificial. The testing situation is not just a normal conver- 
sational interchange, and few, if any, children will fail to realize that they are 
being tested. But, the language of tests and various aspects of the tasks imposed 
should match ordinary language usage as closely as possibly in order to avoid imposing 
lingu:j,stically artificial tasks on the child which require extraneous knowledge^ ^Such 
Knowledge might indeed be language-related, but goes beyond What would properly* char- 
acterize language proficiency. ^ 

Understanding the Test Task 

Occasionally the instructions telling the child what is required by particular tes^ 
tasks are excessively vague about what kind of response will constitute good.perfor- . 
mance."* Tliis becomes a problem in cases whpre something more is requ:ired of t4ie person 
taking the test than simply observing the rules and conventions of normal English 
usage. Children who manage to figure out' what is required jnay do better than those: 
who do not, althougli they actually may not be more proficient at English (or whatever 
latjiguage is being tested). ' ' 

The most common casQ involves test 'items that intend to elicit a particular linguistic 
structure, ±)ut which in fact will not do so unless. a complete sentence response is » 
produced, ^'since the rules of English do not very often require complete sentence 
responses, tests must resort to extra instructions or other manipulation in order to 
elicit complete sentences. Many tests simply instruct the child to answer in complete 
sentences; other tests employ more indirect strategies, using probing techniques or ^ 
tea^rig to elicit the target structure frqm the child. Because the intent of the 
probes is often not clear, these methods can be very puzzling. The Ilyin Oral Inter- 
view states, "It is Important that the respondent give complete sentences; both 
statements and questions. If he gives short answers, the interviewer should instruct 
him to give a longer one.'' ,Qu%te apart from whethei? it is natural^ to demand complete 
sentence answers to all' questions, how does the child know that "longer" means "com- 
plQtq sentence"? Similarly, in the directions ^or the Moreno Oral English Prof iciency 
Placement Test , examples are .given for eliciting the required complete sentence 
responses. In reply to a test questioii. Does Juan have a cat?, a child might well 
answer .iVo. This^:j.s a perfectly natural English answer, but since it .does not serve 
the test purposes, the examiner is instructed to prompt, JVo, what? If the child 
answers [a] policeman in response to What is he?, the examiner is ifistructed to 
prompt. Tell me that... or Tell me more. It is difficult to prisdict what children 
might maka#f these questions, a,nd it may be difficult for them to interpret what is 
exjiected. Assuming the answer to the original test question is truthful, grammatical, 
and appropriate (as is the case \iith the two Moreno ex^ples)^ it might be confusing 
to be probed for a further answer--why is the examiner not satisfied? The child 
might even think a mistake has been made, when in,. fact the given answer is correct 
and natural, but not the one that the test question was designed tt> induce. 

This case .and others involve test instructions that may give test-wi^e students an 
advantage over children who are inexperienced at ^taking tpsts. In these' tests, there 
is an implicit test-taking 3kill~-quite* apart from purely linguistic abilities--which 
can increase the possibilit;y of a high score. So, individual experience may play an 
important role in determining scores.^ / 
* . ♦ 

The Crane Oral Dominance TeiSt consists of a memory task which presents children with 
eight worda, four in English and four in Spanish. . Children must recall as many of ^the 



eight as po:^sitfle, in either language;' if, more English words are repeated, then the 
child is Judged English dominant and likewise for Spanish. Children are told to say 
[the words] any way you wunt/ in English or in SpanisTh (Philosoj^hy and .Di root ions 
Booklet)* N^^^heless; some children may perceive it as part of the test task to 
remember what language each word was presented in, and miight make a conscious effort 
to produce four English words and four Spanish wqWs. To, the e^ctent that they are 
successful at this, they will tend to be judged as balanced bi lingual--dominai1t in 
neither* languaj^. Other chih^ren tnay simply^y to recall words in either language as 
the authors intended, and their scores will/be free of the influence of a conscious 
effort to equalize the number of words. Tttus, if all children do not perceive the 
test tiajsk the same, it may be unsound to compare the final scores of any two and claim 
that the test shows one student to be mora English- or Spanish-dominant t^ian the, 
otiier. \ . . 

Sometimes parVicular items or sections of tests f^equire instructions that pose a 
greater linguistic challenge tl^an the actual response required. In this case, the 
test runs the risk of concluding that students do not know the corrt^ct response when, 
in fact, they may be haviijg difficulty understanding the more complex instructions.. 
For example, on the Listening Comprehension section of the Shutt Primary Language 
Indicator Test , each item is intended to assess compreheijsion of a noun phrase. iSome 
items test .simple noun phrases (a banana)% most items te^t? nouns with relative clauses' 
(a thild.who is pitching, something tied^with a string) ; some test relative, clauses 
that, lack preceding nouns (what a child should take to the teacher on the first. day of 
school). In each case, howev'er, the noun phrase being tested is embedded inside an 
exprq^ssion that is grammatically quite complex: Make an X in the squarre on the' pic- 
ture which shows . For most of the items on the Listening Comprehension subtest, 

^is express ioji is more complex-than the noun phrase expression being tested; this 
adds considerable irrelevant difficulty tOithe task, making it very hal-d to pinpoint 
exac*tly what is not known by students Who miss such an item. 

Ellipsis and Complete Sentences 

Many tests provide a definite instruction to answer in complete sentences or resort 
to some other strategy to try to elicit complete sentences where they, would not nor- 
maUy he required in conversation. We criticized some of these covert ^strategies 
earlier on the grounds that they may be confusing or misleading. However, what is 
wrong wi^ straightforwardly telling children to respond in complete sentences? Just 
this: knowing the cori^ect fom and use of complete English sentences (indeed a com- 
ponent of Engliah proficiency) is not the same as knowing the meaning of the expres- 
sion "complete sentence*" 

It has btfen demonstrated that^eople wjio can speak Etiglish proficiently d6---in some 
sense— know what constitutes a complete fenglifeh sentence* 'mey can construct and use 
complete sentences when the conventions of English usage require it, and when they 
omit complete sentences in their speech, they usually do "5^€tYn certain principled and 
specifiable ways. Native English speakers who ^do not know. that a complete sentence, 
consists of a subject, predicate, etc. still know how to use complete sentences when 
it is appropriate. The ability to use English in this way is knowledge of language; 
'the ability to construct and produce complete sentences on command is knowledge about 
language. Individuals with the skills to produce sentences on command generally haye 
acquired them by formally studying and learning about English grammar, but lack of 
formal training does not necessarily indicate a lack of English ability^ Children who 
faiLito respond in complete sentences when explicitly told to do so might not have 
acquired the Skills to construct complete sentences, or they simply might not know 
what the term "complete sentence" means. It is- possible that some measures claiming 
to test English ability are testing explicit knowledge of the concepts of English 
^grammar. 

Previously, we criticized strategies used in the I ly in Oral Interview and the Moreno 
Oral English Placement Test for trying indirectly ^o obtain complete sentence 
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resDonses. Tests explicitly instructing children to produce complete sententes are 
t>y Short Test of Linguistic Skills , the Caso Test for Non-EnglislySpeakinij^ Students , 
ironfl the E ngiish as a Second Languag Achi^i ^inent T ests, Level 1, Tlie Short Test oT^ 
^ J^n'KuistTc Sicilts tells the cl\ ild, i am ijotng to' ask- you some questions:; in Etnjl ish, 
and I'd like you to anm/er the questions by using a complete sentence (Exominer^s 
Manual, emphasis theirs); the others are equally clear on this point. 

The pervasiveness of ellipsis in normal language usage^ creates problems with the 
scoring strategics used on i;oyoral tests. On one part of the Qtt T<>st af Oral Lan- 
^uajge, students answer questions put by the examiner* Although not directly ^ 
Instructed to use complete sentences or prodded to do so, students* responses are 
graded according to a hierarchy in which simple ijoun phrases get onj9 ppint, verbal 
and other phraSea^get two points, and complete simple sentences get three ppints. * 
This scoring^hierarchy is applied to the answers for all test quest ions^, ^ven though 
conventional ^English usage Requires different kinds of answers to different kinds of 
question^. Questions like What do you see here? inyite noun phrase answe,rs (a dog, a 
man in a red hat) ^s.the most natural, straightforward replies, and questions like 
What are they doing? invite v^rb phrase answers [playing football). The scoring 
scheme for the Ott test would award a better scfte for .unnaturalg^verly explicit 
answers to the above two what question examples ^ The short answers that these ques- 
tions would ordinarily evoke would earn children a lower score. In effect, this 
section oft the Ott test rewards complete sentence answers without regard to whether 
such answNers are natural, and without informing children what is expected. If a 
scoring system rewards performance which deviates frpm standard usage, test subjects 
must be told what kind. of performance is desired. 

The scoring system for one section^ of the Pict orial Test of Bilingualism and language 
Dominance likewise rewards the use of complete ^sentences. Like tne Ott test^ the 
Pictorial test does not specif ical ly elicit complete sentence responses, but still 
assesses a higher degree of proficiency in English if such responses are produced. 

The scoring scheme for the Basic Inventory of Natural Language (BINL) also pbnalixes 
partial sentences,- but ellipsis is nominally allowed/ Correctly used, elliptical 
sentences are to be scored as if they were complete sentences (Instructions Manual)* 
Although an acceptable scoring procedure, there may be some problem in determining 
whether an elliptical respronse has been correctly produced. The problem could arise 
due to BINL, data collection procedures, where data is collectedly gathering children 
together in a group and having one child describe or tell a story about a picture to 
the other children, . Conversational interchange ^among the children is encouraged on 
the assumption that it will^.serve to elicit natural language from the story- tel ling 
child*- Albeit that the ass.bmptian is probably correct and the situation ideal to 
elicit instances of ellipsis, the data that is transctq.bed and subsequently scored 
apparent lYlt consists only of the speech of the pai:ticu^,ar cfiild telling the story. 
Comments fr\d questions from ather children in^the group are last by the time the 
speech sample is scored. (Tlie sample may be mailed away for scoring -by the #fest 
pablishers, who obviously never heard the group conversation that served as the con- 
text for the speech sample.) In order to determi^ne, whether dp elliptical form has 
been used correctly, it is ^crucial to know what else has been said in the context 
where the form occurred. • 

* ■ .' ■ • 

flie Michigan Oral Language Productive Test provides a series ot questions intended ► 
to elicit particular grammatical forms, particula'r words, and particular pronuncia- 
tions. Since corrisct elliptical answers to the test questions would frequently not 
include the structure being tested, the Michigan test adoptjs a strategy in which the 
examin^ prompts the thild with the first word of the desired response. For 

example, in.o>r«^tem intended to elicit past tense^the examiner ^ints to a picture 
of a fish and says^Wh^re did the fi^h jump? The fish.... The child must say The 
fish jumped in the river, using the past tense verb, jumped.^ This strategy is neces- 
sary to prevent the child from answering in the river, which is a pejrfectly natural 
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answer, byt one that does not contain the -desired past t^ise verb. This strategy, as 
with others we have discussed, makes -the test ta^xk very artifickl. In ordinary 
conversation when asking a question; we do not prompt the first few words of the 
oxpoctod answer; whon unswcrinti u question, we do not expect the quest ionCr »lo pro-- 
vide the first few words of the desired response. It is difficult to make test tasks 
approximate ordinary language usage, but tasks like this one run the risk of testing 
understanding of and willingness to comply with the artificial test task, rather than 
the ability to handle ordinary Hnglish usage. The more vaiv^ation there is between 
the test task and ordinary usage, the iflore room tliero js for doubt that the 'test 
actually assesses l^rdiniiry skills. 

In some cases, the prompting strategy employed By the Michij ^ ^an test will not neces- 
sarily be successful in el inciting the dos.ired form. For some items, there may be 
grammatical, coherent, and factually correct responses, repeating the examiner* s 
prompt, .whicL still do not include the desired grammatical or phonological feature. 
In one item, %\\e examiner says. The father wears shoes in this picture. Tell me if 
the boy wears* shoes. No, he.... llio child must artswer No, he dQesn't (wear shoes), 
because the itorjf^ intends to test negated '^i^ but the child might equally say No, he 
has no^sHoes or^No, he's barefoot. Are these answers to be counted wrong? The 
MAT-SliA-CAL Oral Proficiency Test employs the same prompting strategy just described 
for the Michigan test, and is subject to the same- criticisms. ^ 

In conclusion, we will mention a few tests that are noteworthy in that the)^-do yt 
require complete; sentence responses, nor do they score elliptical sentences l^^r in 
environments that natural l))^ permit ellipsis. The Oral Language Dominance >fleasure 
states that "any grammatically correct response in the language being elicited is 
cons-idered accei^table" (Examiner's Manual) , whether or not it contains the specific 
structure that the item was designed to induce. Examples of permissible responses 
make it clear that ellipsis is considered Acceptable. Similarly, the speaking tests 
of the Language Assessment Battery allow for ellipsis, and other coi:rect and appropri- 
ate answers that differ from what the test item was intended to elicit (see Examiner's 
Directions for Administering, Level 2). Hie Bilingual Syntax Measure also allows . 
Qlliptical and other appropriate, grammatical responses as correct answers to test 

items (Manual; Technical Handbook). 

« 

Metalinguistic Instructions 

Til e requirement to produce complete sentence responses poses a metalinguistic task 
for children in that it requires not just knowledge of a language but also some 
explicit, conscious Jknowledge abput a language, about the analysis of its grammar, 
and about the names grammarians have invented to refer to elements of the language^ 
The complete?^ sentence requirement is by far the mpst common metalinguistic task posed 
by language proficiepcy tests, but some 'other tasks and instructions found in the 
tests we reviewed also require metal inguisti6 knowledge of one sort or another. A 
metalinguistic task creates the possibility of confounding— test items may not be 
measuring the linguist^ic skill they intend to. If by instructing them to ask a ques- 
tion, a test seeks to deten^^e whether children can construct an ordinary English 
question, children's failure do this properly could be caused > by ignorance of how 
'to construct an Eng.lish question (as tjie test predicts), ignorance of the meaning of 
the instruction "ask a cjuestion," or ignorance of the word •♦question." As with com- 
plete sentences, children may be able to construct and use questions properly and 
effectively, but not be able tb pro.dijce one on cue. , ' 

The Iiyin Oral Interview contains a number of JL terns of th^s sort: Please ask me a 
question about this picture. Please ^sk a question about this picture using the word 
"after." Several of these items arfe followed by the instruction^ Please answer your 
question. Another item says: fhis picture shows Bill every weekday . Please ask me 
a question about this picture.' Here, the desired response is presumably something 
like What does Bill do ejficry weekday? Apparently, 'these items aim to control the 



form of a response by explicitly indicating what form to usp and'-- in sorife ci^sfes^-what 
words to use. One result of this is to produce a conversational interchange that 
would never be found anywhere but on a language proficiency test^ We usually ask 
questions because we want to know something, not because someone ihstructedus to ask 
a question. People , sometimes require, us to say certain things, but they seldom tell 
us what words to use In saying^ them, and w* are very seldom ipstructed to answer our 
own questions. Performing^ such artifi^cial tasks requires certain test-taking abili<^ 
ties, as well as the ability to spedk English-; , yet. It is only the latter ability 
that is being tested. If the, task is very unlike the usual application of the skill 
being tested; then test-taking skills become relatively more important, and we are 
less likely to be measuring what we want--prof iciency in the ordinrfVy use of English. 

A related metalinguistic problem is found on the Harris Articulation Test . Tliis test 
provides a deta^ed assessment of children's pronunciation of English consonants In 
initial, medial, and filial positions in words. Pictures are presented to children, 
who giust name the objects. , For example, a picture of a ball Is presented to elicit 
the word JbalJ so that pronunciation of initial b can be judged. To get consonants in 
initial position, a single npun must be produced without an indefinite article pre- 
ceding it. If the child says a ball Instead of ball^ then an initial position b has 
not been produced, and the test does not obtain the information it seeks. In art 
effort to control this, the examiner Instructs thd child who produces an Indefinite 
article to dnly say the name of the picture. This may be a puzzling inijtruct ioiV. 
Children who identify the picture as a ball may think they have already said only 
the name of the picture and might wonder why that response is not acceptable. This ' 
strategy is reminiscent of tests that try to probe for a complete sentence respons 
or, failing to get a com|j)lete sentence, ask for a longer answer. ^ 

Another example of a metalinguistic instruction involves tests that Qxi>licitly 
children to respond iiva particular language. In language proficiency testing 
it is legitimate to ^pect a child to be able to respond in the language^ used 
administer the tesf^. Many tests take advantage of this by simply presenting test 
items (oral questions or commands) in the language that is being assessed. For 
example, the Spanish/ Engljsh Language Performance Screening clearly instructs examin- 
ers to use ortly Spanish in the Spanish section and^ only English in that section. The 
Oral Language Dominance Measure separates the two languages completely by requiring a 
Lapse of several days between administration of the EngjL^sh and^^panish sections. . 
These^are logical ^nd probably Qffective strategiles for eliciting responses in a 
particular language* In contrast, it is not necessarily reasonable to expect that 
all children will be able to respond' in the appropriate language when instructed to 
do so. Children might know both language^- and be able to separate them (in the sense 
of being able to speak the proper language in the proper social situation), but still 
not understand the metalinguistic instruction to '^'answer in* English." This is 
unlikply to be a problem witli older bilingual children, who are probably well aware 
that, they speak two languages, but some younger children may be aware of speaking in 
a certain way with some people and differently with others, without being overtly 
aware of the distinction represented by different Ifinguage name^. 

The Pictorial Test of Bilingual'ism and Language Dominance introduces a picture-naming 
•vocabulary test with the instruction. You may answer in either English or Spanish 
(Manual). The Cr^ne Oral Dominance Test , as previously described, sets a memory task 
in which the child must recall a^ set of orally presented word^. Instructions include 
"Sometimes I will say the word in English and sometimes in Spanish. Listen care- 
fully. When I finish, n^ame a^ many words as you can remember. You can say them any 
way you want, in English or Spanish" (Philosophy and Directions Booklet). Under-% 
standing this instruction J^s crucial to the Crane test, Sincfe^a natural response 
might be to report the Spanish words in Spanish and the,bngli^h words in English, 
which would seriously interfere with th'e test's intent. 

The James LgLnguage DomiJiance Test has perception and production secWons in Spanish, 
and then in English^ The only instruction that intervenes between the Spanish and 
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Bnglish sections, to Inform the child that a dhange H&s ttiken plage. Is the examlner^9 
sttftement, Kr#'r# going to tai/f in .Engliah. Look at thMd picturBB (Manual,)* The^. 
abruptness of thrf chang^^ from Spanish to HnnHHh might po^^e some problems in shifting 
from one language to the other* (Contract the complete sepaiution of languages 
required by the Oral language Dominance Measure Q /The James test^also recommends 
using a metalinguistic instruction if the chilcl responds in the wrong language. For 
example, on the^ Spanish section, if the child resportds in Bnglish, the examiner is 
Instructed to say Dimelp eti Bspafiol . As we Indicate abqve, this may not be an (effec- 
tive way to obtain Spanish resjKjnses from some young children, 

l-inally, the I'le'xibility Test to Measure Language Pominancg in Spanish-English Bilin- 



Hj;ual s is a test b^^ a unique type, in. which children presented with a set o^ eighth 
scrambled letters are first told to construct as many Spanish words from those 
let.ters as possible in 60 seconds, arid then to construct as many English wojrds as 
possible from the letters. Tlvis process is repeated five times with five different 
sets of eight sci^ambled letters* To accomplish the task, children must be able to 
make a clear ^wkI conscious distinction between English and Spanish when instAicted 
to do so. So, tJiis task is open to the jpriar criticisms that successful performance 
requires a certain kind of metal inguistiK: knowledge. - 

Identical Test Items in 'l\vo Languages 

Another way in which the overall organization of jiest tasks can deparfT from everyday 




^ Ikp o « 

.Ordinarily, there is no point in asking the same person the same question twice, 
Either the question is answered correctly or it is not, ^and for testing purposes, 
that is all thpt is required. ^ . • 

The identical item format usually asks simple short-answer question$, whith decreases 
the pretense that the testing situation is just an ordinary conversational interac- 
tion* It is open to argument whether it is worthwhile to' try to maintain any such 
pretense. Some tests try to do so overtly (e.g., .the Basic Inventory of Natural Lan- 
guage and the Bilingual Syntax Measure) ; many more do nOt . Tests should assess 
ordinary conversational language ability and normal language usage as much as posr 
sible, and tests that adopt features different from normal usage must show that they 
do not interfere with the assessment of the ability to use language ^n ordinary cir- 
cumstances 

Even though it is conversationally unnatural' to do so, a bilingual child will prob- 
ably have no trouble answering a question like (mat is your natnm? in both languages. 
However, tests whicfi require longer, descriptiveVor creative answers, and which 
duplicate the task in two languages, may indeed cratAte bias problems. One part of 
the Pictorial Test of Bilingual ism and Language Pomt^ia^ involves showing children a 

I picture and asking for a story about it-^-first in Bt^ish, then in Spanish. ^ The 
children, of course, have the option of making up two different stori^ about the 

'same picture, but if they choose to tell the %me story twice; it is likely to be 
shorter and less elaborate the second time. , . Children may not feel it necessary to be 
as careful or precise about introducing characters just introduced or describing 

is i that ions al read/ described. They may use more pronouns and more ellipsis the 
second time, assuming (correctly) that the examined will understand what is being 
said, since it all has been said before. The test, however, is scored according to 
the completeness of the thoughts expressed, and the demonstrated expression of com- 
plete subject-verb-ohject sentences (ManuaV) • Children •'S performance in the second 
language is liable to appear less .complete, and so less proficient, pyrely as an 
artifact of the test format. . ' " ^ 
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On© section of the Spanish- English Dominance Assessment Test also adopts the format 
of picture description. Examiners create their own pictures representing local 
conditions, hut It is not clear froln the tost materials whether children iwc required 
to describe the same picture twlco> in Spanish and then in linglish, or to describe 
one picture in Spanish arid a different one in English. In yiew of the abov^e consid- 
erations, it would seem preferable to follow the latter procedure. 

» 

Finally, one way to overcome the problems with identical test items in two different 
languages is to administer the English and noa-English sections of the test on dif- 
ferent occasions. After a lapse of a few days, it might be less unnatural to ask 
children to answer questions already answered. V\e Oral Language Domi nance Measure 
follows this procedure. 

IMPLICATIONS OF SECOND LANGUAGE ACQUISITION FOR TESTS V 

Most teats which purport to assess relative English proficiency are impl icitly based 
6n ^ idea that poopler tend to learn structures which are easier, sentence types 
whi<fh are simpler, and vocabulary which is somehow more basic, before mastering more 
complex and difficult parts of the system. While this is a reasonable assumption, 
the content of many tests. still is based on notions of complexity which are supported 
neither by linguistic theory nor by empirical evidence of how children acquire Eng- 
lish aSw a second language. 

Children acquire language through a s/stematic developmental process in which they 
actively and creatively build up knowledge of the* language system. Thrjough contact 
with language in everyday situations, they gain a sense of how.utte'rances in the 
language are structured and organized, and gradually they integrate these linguistic 
structures into an internalized grammatical systejn for the langUage. This process is 
frequently termed language acquisition to distinguish it from conscious, deliberate 
language learning. , 

ITiere are various kinds of evidence which suggest that the language acquisition 
process is guided by some property of .cognitive organization — some special capacity 
for dealing with language structure which all children have. Among the kinds of 
evidence advanced for, this view are the following: 

•Children learning any language not only repeat and imitate speech, but they 
also produce new, unique sentences which they have tiot heard before, 

• Many of the "errors'" made by children learning English as a second language 
are similar, regardless of the native language of the child. 

• Second language learners tend not to transfer syntactic patterns of their 
native language to the new language; errors appear to be developmental rather 
than to result from first lang^iige interference. 

•Stages* ifi the languajge acquisition process appear similar in children from 
different learning eiivironments. 

•Stages in the second language acquisition process are apparently not guided by 
external input factor? such as the auditory salience/ of speech elements or 
corrective feedback from other people (although this point is somewhat contro- 
versial). ■ ✓ • * 



Tj\e acquisition o^. language structure, then, tend^ to be a systematic and regular 
process. As they build competence in the new language, all children tend first to 
master certain types of structures, later developing control of sdmewhat more complex 
structures. In the acquisition of English as a second language, characteristic 
patterns of word orcier.for English sentences are typicaTly mastered befote any 
higher-level markers of grammatical relationships. Research also shows that use of 
the singular copula is is contr<idled before the short plural marker -s, and that both 




of those structunes aro controlled before the possessive morpheme 's-* Other research 
has shown that children learning English as a second language use is before they use 
do and can; furthermore, children us^ all three of these verb forms before beginning 
to inflect any of thorn for number or tense (as in w^ks, Mto, did), and also hoforo 
other models {willi would, must) appear in chlldren*s speech. Iliese are jus,t a few 
examples of regular patterns which all children acquiring Hnglish as a second lan- 
guage tend to follow* 

The ncqui?;ition of Rnglif^h grammatical morphemes is not a linear and additive 
sequence; rather, structures seem to fall into groups^ and children tend to acquire 
the structures within one group before they gain control of those in another group. 
This hierarchy of Hnglish structuros--which is supported by emi^irical evidence from 
language acquisition research--predicts that if children control some grammatical 
structure which is relatively high ii\ the hierarchy (i.e., which is predicted to be a 
relatively* late acquisition), they will also control, structures which are acquired 
earlier. Conversely, children whose speech does not indicate control, of some rela- 
tively low-level structures (i,e-, relatively early acquisitions) will probably also 
lack more difficult structures. 

nie fact that there are such hierarchical patterns in second language acquisition has 
important implications for testing Knglish proficiency. These patterns make it pos- 
sible — in principle at least — to design a test in such a way that when children 
demonstrate control (or lack of it) pf certain grammatical structures, we can learn 
more about their language ability than just their facility with those particular 
structures. Wo can also infer something about placement on the putative language 
acquisition hierarchy, and thus gain information about the. developmental level in the 
acquisition of Hnglish. 

lype of Language Knowledge Tested: Discrete Point 
vs. fntegrative Testing 

For some children there may be a gap between the ability to use English in n^^tural 
interaction, and the ability to perform formal "tasks in situations which invite 
conscious attention to language form (such as some testing situations). The first 
type of ability wijl reflect a stage in the developmental process of language acqui- 
sition; the second wi 1 1 not. ^ ^ 

In evaluating tests which claim to assess students' control of English grammatical 
structure, it is important to recognize which of these two types of language knowl- 
edge a test is trying to assess and what the test reveals about students' develop- 
mental lervel of English acquisition. Depending on the design of the test, it may 
elicit representative evidence of students' internalized control of English struc- ^ 
ture, or it may yield an inventory of some of the precise rules of grammar students 
have learned. In the former case, a test scl?re might indicate (in part) students' 
ability to use English in meaningful interaction, and placement in the developmental 
process of acquiring English* In the latter case, the test 'score might provide no 
information about either of these important points. 

English proficiency tests which include some measure of grammatical ability usually 
fall into one of two general categories: integrative and discrete points Integrative 
tests obtain evidence of students' overall control of the language by having trhem 
produce connected discourse in some meaningful context. For example, the Basic 
Inventory of Natural Language , the Language Dominance Survey , the Language Facility 
Test, the Oral Language Evaluation , and the Pictorial Test of Bilingual ism and UnV 

*Note that these three grammatical morphemes are all typically m^ifested by the 
sound of s^^and are thereby auditorily equally salient to the perceptions of the 
language learner. This case is one example of the third type of evidence mentioned 
above for the existence of a natural sequence in the acquisition process. 
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guage Dotninmico require children to describe or tell a story about pictures. A few* 
tests, such as the Language Dominance Criteria ^ educe conversation in the form of 
answers to personal questions. Discrote point tests, on the otht»r hand, consist of 
items designed to test a number of specific structures or rules^-discrete points in 
the language system. Generally, each item tests one such point, independently of 
other items which test different points. In such a test, all the items taken together 
are considered to be a representatjjftf^^sampling 'of the structure of the language, or 
at least of some part of its structufe— grammar , plionology, etc* 

7 

Integrative Tests. Because integrative tests have the virtue of eliciting natural / 
discourse, the. language produced in such tests will reflect the acquired knowledge of 
Hnglish structure; but, of the integrative tests reviewed, none yields any useful 
information regarding the degree of control of grammatical structure or developmental 
level of English acquisition. 

A general problem with integrative testing is that a sample of natural discourse will 
provide information only about the grammatical structures which happen to occur An 
the sample. It will provide a basis on which to assess thp control of those struc- 
tures, but it will not provide information about the control of any structures which 
do not occur. We will learn something about control of irregular past tense from the 
student who, for example, utters either He took a nap or He taked a nap, but we will 
have no basis for making such a judgment if, in the discourse, no irregular verbs 
occur in past tense. ^Tliis fact limits the evaluative and diagnostic potential of 
integrative tests. , ' 

A second and greater problem with the integrative tests we reviewed lies in the 
nature of their scoring procedures. The types of evaluations which are made of - 
elicited discourse are either so gross as to be unrevealing,. so subjective as to 
limit their value, or based on misguided notions about language. One example of 
gross and unrevealing scoring procedures is provided by the Language Dominance Cri- 
teria , where the scorer simply indicates the presence or absence grammatical 
errors in the discourse. Similarly, on the Chicago Sliort Test of Linguistic Skills , 
the scorer indicates whether there are major or minor grammatical errors, with no 
more than a few ungeneralizable examples to guide judgment. Examples of extremely 
subjecti.ve evaluations can be found in the Language Facility Test ,, in which the 
examiner judges the organization and descriptive adequacy or the discourse; in the . 
Oral Language Evaluation ^ in which the discourse is judged in terms of concrete 
versus abstract content; or in the Language Assess ment Scales, in which language 
production is judged to be incoherent, labored, near perfect, or perfect. (The 
last category is an ideal which not even native speakers would characteristically 
achieve.) Other tests, such as the Basic Inventory^ of Natural Language , Spanish^/ 
Engjlish Language Performance Screening test, or Test of Grammatically Correct Span- 
ish/English , involve scoring oi' sentence length or complexity. Whatever Value may 
lie in some of these scoring procedures, it is clear that none yields diagnostic 
information about students' control of English structure, and none indicates devel- 
oi^nental' level of English acquisition. 

i 

Discrete Point Tests. One of the advantages of discrete point testing (which enables 
it to overcome or avoid the problems associated with integrative testing) is that it 
can, in principle, assure controlled representation of stn\ctures or rules which, for 
one reason or another, are considered important. However, one of the main disadvan- 
tages of discrete point tests is tha^ it is difficult- to extract natural language 
responses while maintaining close control Qver the grammatical structures to be pro- 
duced. 

Tliere are two groups of discrete point grammar tests whose .tasks do not cause stu- 
dents to produce any spontaAeoMs natural language, and which will therefore fail 
to yield information regarding students* developmental level. of English acquisition* 
The first group includes tests of aural compr^ensi6n, such as the Comprehension of 
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Oral - Language Test ^ or sections of the Language Assessroent Scales » the MAT-SEA'-CAL' , 
the Language AnsMsm ent Battery ^ or the Milwaukee English aai a Second Language 
Achievoment Tests , As previously discussed, it is very difficult to'assoss control 
of grammatiV^ structure by trying to evaluate passive comprehension. Furthermore, 
auralf corapreheh<|j^n does not necessarily reflect students' ability to speak the 
language. - . 

The second group of t^sts which does not involve elicdtution of spontaneous natural 
language includes tests with sentence repetition tasks, such as the Northwestern * 
Syntax Screening Test or the Del Rig Language Screening Test . It should be mentioned 
that both the Northwestern and the Del Rio tests are designed to identify children 
with delayed or deviant language development. TTie manual of the Northwestern test 
(to its credit) states that "a bilingual chi Id. . .should never be judged as /language 
delayed* or 'language deficient' by his scores on the NSST." In contrast , -the manual 
of i the Del t^o test says that "though not originally intended for use in determining 
a child's degree of bil ingual ism, the test may be used for this purpose--a useful and 
needed additional benefit." Neither test, in fact, can usefully indicate a normal 
bilingual child's developmental iWel in English acquisition. 

Items in most of the discrete point grammar tests reviewed evoke a structured response 
of some tyi^c. Some, such as the Michigan Oral Language Productive Test , the MAT -SEA- 
CAL, and the Lan^ ua ^e Assessme'nt Battery , offer a statement or question "cue,*' :^ol- 
lowed by tjie beginning of a response sentence which students are expected to complete. 
Iliis task seems to, decrease the likelihood that responses will demonstrate relatively 
unmonitored, spontaneous natural language production. Other tests, such as the 
Moren o Oral English Proficiency Placement Test , the Ilyin Oral Interview , the English 
as^ Secon d Lang uage Achievement Tests , the Case Test for Non- English Speaking ^Ui- ^ 
dents, the Bilingual Syntax Measure , the Bahia Oral Languag e Test, ai>d the Oral Lan - 
guage D ominance Measure , simply ask questions to which students respond. Certain 
features in the design of these tests prevent many of the test items from eliciting 
natural language. 

Beyond the technical design problems, the degree to which structured response items 
will succeed in obtaining natural language depends not only on the content of ques- 
tions asked, but on such dif f icult-to-control factors as the testing situation or the 
skill of the examiner in creating a relaxed situation. The le^s test items resemble 
ordinary conversation, and the more formal the testing situation, the more likely it 
is that student responses will reflect a high degree of self-monitoring. One conse- 
quence of this formal, self-monitored situation might be to produce reticence or 
anxiety on the part of the student and consequently a poor picture of language abil- 
ity. Another outcome might be that, in many cases, the test could yield evidence 
of learned grammar rather than the internalized, acquired language knowledge which 
enables the student to use English for communication and learning. Among discrete 
point tests, the Bilingual Syntax Measure , the Bahia Oral Language Test , and the 
Oral Language Dominance Measure appear to have a high potential, properly adminis- 
tered, for eliciting natural language. 

As we have tried to show, neither discrete point nor integrative testing has an over- 
riding advantage oyer the other for purposes of assessing students' developmental 
level of English^acquisition. Integrative testing has the virtue of elicJLting natural 
discourse, but in order to be diagnostic of language development, its scoring pro- 
cedures would require a type of analysis of the discourse which no test currently 
incorporates. Discrete point testing carv ensure coverage of structures needed for 
assessment, but often fails to educe the natural language which would reflect stu- 
dents' placement in the developmental process. Both approaches, in principle, hold 
potential for improvement in further test development. 
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Correspondonce between Test Content 
anil Acquisition Order 



Some structured-responsot ^discrete v^int tests of grammar do seem to have potential 
for eliciting natural language* In evaluating these tests* ffcnrther, we need to ask 
what correspondence exists between linguistic structures tested, and which ones indi- 
cate the natural acquisition order of Onglish (to the extent documented by research). 

This is a crucial question to ask of any test claiming to be representative of Eng- 
lish grammatical structure. The tests of this nature which we reviewed are all 
based--implicitly or explicitly--on some hierarchical list of supposedly representa- 
tive grammatical structures or, in some cases, concepts. Such hierarchical lists 
will claim to reflect one of two things: first, they may claim to represent the way 
the English language really is, or second, they may correspond to some artificial 
classification of English structure, such as a specific instructional curriculum, ^ In 
evaluating a discrete point grammar test, we have to consider what motivated the 
selection of structure on the test (the content of its items) in order to know what a 
score on that test reveals about studepts^ language ability. If the hierarchy of 
structures on a test reflects the natural acquisition order* of English structure, 
#then performance on the test will tell u$ something about development in English. If 
the test content does not reflect that 'order, we have to ask what it does tell us 
about the student, and of what Value that information is. Jhe following discussion 
will illustrate these points. 

■ 

Items on the Moreno Oral English Proficiency Placement Test correspond in content and 
sequence to a particular set of curriculum materials (available from the same company 
which markets the test), but do not correspond to any acquisition order revealed by 
language acquisition research. For example, research indicates that the plural 
copul^ is a relatively early acquisition, while possessives are acquired later, Butv 
on the Moreno test, items to test possessives occur early, while litems inducing, 
the plural copula occur late, and the scoring procedure might prevent the child who 
misses the possessives from ever getting to the copula items. Similarly, the Moreno 
test sequences irregular past tenses before progressives, the reverse of the natural 
order of difficulty. Students* scores on this test, then, will indicate place in the 
particular curriculum oi) which the test is based, but will not indicate much about 
actual English proficiency. In the case of curriculum-based tests like' this, diver- 
gence from the natural order of acquisition is»ai* problem properly located in the 
curriculum rather than in the test. 

For several tQsts (or the grammar sections thereof), such as the H/iri Oral Inter- 
view , the Caso Test for Non- English Speaking" Students , the Milwaukee Englj.sh as a 
Second Language Achievement Test's, or Language Assessment Battery , it is not clear 
why the item content--or the' weighting of different structures--is what it is. On 
the Milwaukee ESL Tests , for example, over half the questions extract responses of 
the form noun ^ be ^ predicate. Scores on this test will^e determined in large 
part by students' control of this particular type of structure, whiXe control of 
other aspects of grammar will not be indicated. On the Language Assessment Battery , 
r there are items which elicit structures whose role in the system of English is rela- 
' \^^^J^J^ely idiosyncratic, such as the prepositional phrase of + noun in the stimulus 

SOTCence It ia a telephone^^^booth full ^. Such an item, which does not indicate 

control of any gen«)^al rule of the language, contributes little to an assessment of 
proficiency* 

Items Qtf the MAT?$EA-CAL test also bear mo apparent- relationship to the acquisition 
order'^of English,, and reflect no formally motivated analysis of the structure of 
English*! Items are designed to test skills in eight concept areas. Some of these 
concepts represent clusters of grammatical forms (e.g., temporality, including verb 
tense and'aspect), while otherfe seem to be semantic or cognitive categories (e.g*, 
classification or identification), which are not grammatically motivated. Scores 
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.which are catogorizod In terms of these concepts will indicate very little about 
students' control of English structure. 

Item content on the Michigan Oral L^n£i^age Productive Test appears designed to pro- 
vide coverage of known features of^ nonstandard varieties of English, particularly 
Black Vernacular English). For example, one category of items tests for double 
negative; if the test were truly intended to reveal the English proficiency of non- 
native speakers, there would be no reasgn to test for this kind of linguistic feature, 
because there is no developmental stage in the acquisition of English which is char- 
acterized by the presence of double negatives. This is, rather, a feature of the 
nonstandard dialect of English spoken by many persons with native proficiency. 
Tl)is assessment of the Michigan test is borne out by this scoring procedures, which 
give credit to specified standard English responses,^ lumping together nonstandard 
and Other responses; This test, in bther words, equates those whose responses reflect 
native proficiency in a nonstandard variety of English with non-native speakers of 
English whose responses indicate they are in the process of acquiring English as a 
second language. Yet, the knowledge of English is fundamentally different--quali-, 
tatively and quantitatively--in these two cases. Hie Michigan test will reveal little 
about the developmental stage of students acquiring English as a second language. 

w 

The content of the Bil ingual Syntax Measure (BSM), the Bahia Oral Language Test 
(BOLT), and the El Paso Oral Language Dominance Measure represents a number of Eng- 
lish structures for which some order of difficulty has been established by research. 
To this extent, then, there is a good rationale for the claim that these tests assess 
English proficiency. In the BSM (remarks here refer to the *'hierarchical .scoring . 
method") and BOLT , however, scoring procedures introduce some possibility that the 
tests might fall short of fhat goal. In these tests (as well as in the El Paso test), 
each item is designed to elicit an utterance which will contain a particular type of 
structure — the target , structure for that item. Responses are acceptable if they are 
grammatical and appropriate in the context of the given cue question. In the BSM 
and BOLT , different subsets of items are taken to represent different levels oi pro- 
ficiency. Thus, students* proficiency levels according to the test depend not on a 
numerical total of acceptable responses, but on performance on the specific subsets 
of items. TTie rationale for this is that the target structures for the items are 
located at different paints in the acquisition hierarchy, so that students* perfor- 
mance on certain items will indicate placement in the developmental sequence. 

Hiis procedure rests on two assumptions, neither of which seems entirely safe to 
make: (a) each item will, in fact, elicit its target structure (rather than an 
acceptable response which does not contain the target stmcture) and (b) if responses 
to an item are unacceptable, this will be because the target structure, rather than 
some other part of the response, is ill formed.^ If either of these assumptions fails 
'to hold— which must sometimes be the case — the scoring procedure will be robbed of 
the basis for relating scores on specific items to proficiency levels. 

A further problem with these tests is that they place a very heavy reliance on the 
details of the acquisition hierarchy which they are designed to represent. Some 
investigators would argue that it is premature to trust the research resultftron 
acquisition sequence beyond a certain level of detail. Furthermore, these tests 
make the implicit claim that the acquisition hierarchy that has been uncovered is 
generalizable to every child learning English. They do not allow for the possibility 
that there may be individual variation within the general acquisition sequence* 

Ttie El Paso test yields a score which represents the numerical total qf acceptable 
responses. In this, it avoids problems discussed above, but perhaps at some cost of 
diagnostic potential. Translation of scores on the El' Paso test into proficiency 
levels is based on statistical analysis of scores from a local field ^test population^ 
and this analysis' would have to be repeated for other Local populations before the 
test could be used to provide proficiency level data in other locations. 
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CATALOGUE OF TESW . ' 

* . » 

Part Two is an alphabetical catalogue of the 38 tests reviewed/ It provides certain 
general information about each test and adds some evaluative coram«nts which may not 
have been covered in Part One. It also serves^ as an index to Parl^ One"^ citing where 
a particular test^ is discussed or where examples drawn from particular tests are used 
to illustrate issues in language proficiency. In cases where m test Vas not'men- 
tioned in connection with a particular topic, the index references the discussions 
that are useful for evaluating the test. Readers who are considering using any of 
these tests should consult these sections. 

Additionally, the catalogue contains information abo^what the test iB intended * 
to .measure, either as stated in the test's technical materials or, if not stated, as 
we determined it through analysis of the test. A statement of what tasks are actu- ^ 
ally requi;:ed of people taking the test (e.g., answering questions, pointing at pic- 
tures, performing commands, etc.) is also provided** We believe that it is essential 
to know these details in order to get an idea of what the test isf like, and what it 
would be like to administer the test in .an educational setting. 

Information about the existence pr outcome of experimental studies of reliability 
and validity for each t6st has not been included. We have also not Included any 
judgments about the acceptabilijty. or qnacceptability of any test, either in general " 
or with respect to particular topics of interest, such as cultural fairness, layout 
and design, age/grade appropriatenes^, ease of .^iidministration, or cost economy. 
These issufes we consider to be beyond the scope of t^e present review, and we believe 
that categorical judgments of acceptability in the absence of any explanatlprt cannot*^ 
be regarded as very useful or trustworthy information. Technical and statistical 
data, results of experimental field testing, and judgments concerning various aspects 
of overall acceptability are available in a number of previously published t^est cata- 
logues andreviews. Some of those publications** now available are: 

Backer, Thomas E, A Directory of Information on Te;sts (TM Report 62) > ERIC Clear- 
inghouse- on Test's, Measurement and Evaluation, 1977, ED 15.2 aQ2„ 



Bye, Thomas T. Tests that Measure iLanguage Ability . Berkeley 
Berkeley Unified School District, 1977. ^ 



, CA: - BABEL/LAU Center 



^ The puhi i ca tlon t es t s that Measure Language Ability contains information about what 
each test measures and what tasks ^re reguired. We acknowledge their lead in our 
decision to provide this ^information in our own review. 

**These catalogues vary i^idely in terms of .the type and amount of information they 
'offer; some will be more informative and useful than others to school personnel 
faced with the task of selecting among tests. The list i^ presented here for infer*- 
mative purposes only, and inclusion of any publication on this list does not 'nece:^- 
sarily repre)3ent an endorsement or recoi^bneiylation of that publication by the present 
authors* ^ jt ' 



Califomla Association for Bilingual Education.- A Qut^Utativo Rovlow of Instrusents ^ 

Usod In Bilingual Bducat Ion Programs In California , San Jose, CA: Teit Pvalu*^ 
at ion Conference, April 1S^6. ~l 
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IL; National Council of Teachers of Engllsii, 1976. ED 120 73^ - ^ 
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ton, DC: hiatlonal Institute of Education, 1978. ED 163 062 ' 
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MA: Newbury House, 1978. , 
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Ush'Speaklng Students . New York: Santlllana, Publishing Company, 1§78. 
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de l^UnlversltS Laval, 1977. ED O32' 540 

V 

Silverman, Robert J., Joslyn K. Noa, and Randall H. Russell. Oral Language Tests 



for Bilingual Students: An Evaluation of Language Dominance and nroficiefTi^y 
Instruments . Portland, OR: Northwest Regional Educational Laboratory, l9/6. 
ED 129 099 



BAHIA ORAL LANGUAGE TEST 



AUTHORS: 
AVAILABLE FROM: 

DATE: 1976 

TEST INTENDS 
TO MEASURE: 



Sam Cohen, Roberto Cruz, Raul Bravo 

Bay Area Hispano Institute for Advancement (BAHIA, Inc) , 
PO Box 9337, North l^erkeley, CA 94709 

AGE/GRADE LEVEL: grades 7-12 

Ordl proficiency by testing control of specific grammatical 
structures 



TASKS INVOLVED: Students answer examiner's questions about pictures 



INDEX TO 
■PART ONE: 



Ellipsis and Complete Sentences; Identical Items in Two. Lan- 
guages; Discrete Point vs. Integrative Testing; Correspondence 
between Test Content and Acquisition Order 



BASIC INVENTORY OF NATURAL LANGUAGE 



AUTHORS:. 
AVAILABLE FROM: 

DATE:' 1977 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



Charles H. Herbert 



CHECpoint; Systems, 1558 N. Waterman Ave, Suite C, San Bernardino » 
CA 92404' 

AGE/GRADfe LEVEL: preschool -adult 

Fluency (total number of words used); level of complexity (command 
of linguistic structures, *incl-uding sentenced, modifiers, phrases, 
and clauses) 

Students describe qr tell a story about a picture, producing an 
extended sample of connected speech (the sample should be produced 
in a conversational context „or interchange with other students) 
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INDEX TO 
PART ONE: 



Notions of L:^nguistlc Complexity; Counting Linguistic Elements; 
Ellipsis and .Complete Sentences; Identical Items in IVo Languages; 
Discrete Point vs. Integrative Testing 

Re Linguist j^c Complexity : A "Grammatical Index" serves as the 
l)asis ioT one of thfe scores on this test, and makes certain cora- 
mitpents about the relative complexity oi various linguistic forms. 
The relative \/eights assigned do*not seem to^ be well motivated, 
either from the pcrint of view of linguistics or second language 
acquisition. ♦ ^ ' 



BILINGUAL SYNTAX MEASURE 



AUTHORS: 
AVAILABLE FROM: 

DATE: 1975 

TEST INTEND^ 
.TO MEASURE: 

TASKS INVOLVED: 

INDEX TO 
PART ONE: 



Marina K. Burt, Heidi C. Dulay, Eduardo Hernandez -Chtfvez 

Test Department, Harcourt, Brace, Jovandvich, Inc, 757 Third Ave, 
New Ybrk, NY 10017 

AGE/GRADE LEVEL: grades K-2 

Control of specific g^^minat^jiteal structures related to thu acquisi- 
tion sequence ^n English grammar 

Students answer examiner's questions about pictures 

Ellipsis and Complete Sentences; Identical Items in TWo Languages; 
Discrete Point vs. Integrative Testing; Correspondence between Test 
Content and Acquisition Order 



BROOKS COUNTY LANGUAGE USAGE INVENTORY 



AUTHORS ^ 

AVAILABLE FROM: 

DATE: None 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE; 



Brooks County Independent School District, Falfurrias, ,TX 78355 
AGE/ GRADE LEVEL: Not indicated 

General comprehension; language preference (In particular social 
situations); vocabulary - • 

Students answer questions About themselves, the examiner's actions, 
and the language used or preferred , in various social situations; 
students point to pictures in response to the examiner,' s instrtic- 
tions 

Self-Reported Data; Understanding the Test Task; Identical Items 
in Two Languages 

Re Understanding the Test Task : In this section, we criti- 
cized some tests for implicitly 'assuming that all students will 
have an explicit awareness that. a certain way of speaking is called 
"English," while a different way is called "Spanish." The Inven- ■ 
tory recognizes this and recommends sora'b preliminary discussion to 
ensure that students understand when the examiner refers to English 
and/or Spanish. *^ 



CASO TEST FOR NON- ENGLISH SPEAKING STUDENTS 
AUTHORS: Adolph Caso 

AVAILABLE FROM: Adolph Caso, Waltham Public Schools, Waltham^ MA 02154 
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DATE: 1975 



AOE/ GRADE LEVEL: grades 3-8 



Ti:ST INTENDS 
IX) MbASURE: 

TASKS INVOLVED: 



INDEX IX) 
PART ONE: 



Phonetics and spollinf?; vocabulary; roading and listening oomj^ro- 
hension 

Writing letters and words from dictation;, identifying synonyms, 
antonyms, and related words; multiple-choice questions about a 
reading passage; multiple-choice questions about a dictated passage 

Tasks that^il^quire Literacy Skills; Ihe Value of Vocabulary Tests; 
Measures of Linguistic Creativity; Ellipsis and Complete Sentences; 
Metalinguistic Tnstructions ; Discrete Point vs. Integrative Test- 
ing; Correspondence between Test Content and Aoquisition Order 

Re Literacy Skills ; TWo parts of the tesrt require literacy 
skills in addition to oral English proficiencyV- Part I (phonetics) 
requires students to wrr^fi letters and spell vyords from dictation; 
Pant II (comprehension'J'^re^i^ students W^read words and iden- 
tify synonyms and antonyms Trom written lists. 

Re Meta linguistic Instructions : Spelling ability and rJ\e 
recognition of synonyms and antonyms are skills that, are ba^d on 
an explicit analysis of language rather than skills that properly 
constitute. language proficiency. These are metalinguistic tasks. 



COMPREHENSION OF ORAL LANGUAGE 



AUTHORS: 
AVAILABLE FROM: 



DATE: None 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



Not indicated * 

Guidance Testing Associates, St. Mary's University / 2700 Cincinnati 
Ave, San Antonio, TX 78284 

AGE/GRADE LEVEL: Not indicated ^ . 

Comprehension of words and certain grammatical structures 

Students identify pictures corresponding to words and expressions 

presented orally by the examiner ^ 

• ■ ■ • 

Tasks that Reduce to a Vocabulary Test; Passive Comprehension; 
Tlie Value of Vocabulary Tests; Discrete Point v?. Integrative' 
Testing • " - . ^ 

Re Tasks that Reduce to a Vocabulary Test : Students identify 
pictures corresponding to sentences ^siiok en by the .examiner. ,0n 
many of these items, students can identify the'correct picture by 
understanding only a word or two, and need not understand the \ 
whole sentence. It is notcertain that such items test sentence 
comprehension; rather, they may tap 6nly vocabulary knowledge. 

Re Discrete Point vs> Integrative Testing : See esfpec^ially the 
discussion in this section regarding the' inadequacy of aural com- 
prehension tests for ind^icating students def\;eiopmental level of 
English acquisition. 



CRANE ORAL DOMINANCE TEST 



AUTHORS: 



Barbara J. Crane 



AVAiLABLfe FROM: Cran« Publ ishlng Co, /1301 Hamilton Ave, PO Box 3713, Trenton, NJ 
' ' 08629 



V 



DATE: 1976 (reviwed) 

1978 revision aveilablo 



AGE/GRADE LEVEL: 4-8 years 



TEST INHiNDS 
TO MEASURE: 

TASKS IMVOLVED: 



INDEX TO 
PART ONE: 



Dominant internal language; memory for linglish and Spanish vocabu- 
lary items 

• * 

Examiner orally presents a listrof bight words to students, four 
in English, four in Spanish; students recall as many words as pos- 
sible in either lapguage 

Tasks that Reduce to ^ Vocabulary Test; 'Mimicry; Understanding the 
Jest Task; Metalinguistic Instructions 

Re Mimicry : The memory task imposed by this test requires stu- 
dents to repeat words spoken by the examiner* Students usually are 
able to remember more words in a given language if they understand 
the words; however, the ability to mimic words, without necessarily 
understanding them, cannot be ruled put as a factors-affecting per- 
formance on this test. 



DEL RIO LANGUAGE SCREENING TEST 



AUTHORS: 

AVAILABLE FROM: 

DATE: 1975 

TEST itjTENDS 
TO MEASURE: . 

TASKS INVOLVED: 



INDEX TO 
PART ONE: j 



Allen S. Toronto, D. LeVerman, Cornelia Hanna, Peggy Jtosenzweig, 
Anton eta Maldonado 



Not indicated 
AGE/GRADE LEVEL: 



3-6 years 



Receptive vocabulary; sentence repetition, or memory; comprehension 
of oral commands; story comprehension 

Students identify pictures corresponding to words presented orally; 
the examiner presents a series of sentences of appro^iimately equal 



compleatity, but increasing length, and students recal 



the 



)le3t| 
seru^ 



ences; students perform, oral commands j)resented by the 



stories 



examiner; the examiner reads orally a series of five 
increasing in length and complexity,, and s^J^dents ^s^er questions 
presented orally after each stc/ry 



1 and repeat 



\f Vocabulary 
vs. Inte- 



Notions of Linfguistic Complexity; Mimicry; The Value 
Tests; Ellipsis and Complete Sentences; Discrete Poin 
grative Testing 

Re Ellipsis and Complete Sentences : In'scoripg tlhe "Story 
Comprehension'^ subtest, normal, elliptical answers to lexaminer's 
questions are counted correct.* This, test avoids the ejrrors pointed 
out in this sectioji. * ^ 



ENGLISH AS A SECOND LANGOaGE ACHIEVEMENT TESTS-^LEVEL I 



AUTHORS : 
AVAILABLE FROM: 

DATE: Jf'978 

/ 

TEST /ntENDS- 
TO MEASURE: 



Helen McGuire, Susan Rao 

Milwaukee Public Schools, Department of Education. Research and 
Program Assessment, PO^^Drawpr lO-K, ^Milwaukee, WI ^5201 

AGE/GRADE LEVEL: grades K-12 (listening and speaking) 

grades 6-12 (reading and writing) 

Listening comprehension, correct: pronuncigit ion and intopation; 
reading (not reviewed); writing (not reviewed) 



TA9KS .INVOLVED: Students identify pictures corresponding to sentences anji "l^tories^^ 
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V 



INDEX TO 
PART ONE: 



(9#qudncM of severaJb sent#nce9) presented orally; students repeat 
words and sentences presented orally by the examiner; students 

answer personal and general questions 

Tasks that Reduce to a Vocabul^^ Test; Mimicry; Passive Compre-^ 
henslon; TTie Value of Phonology or Pronunciation Tests; Counting 
Linguistic Elements; Blllpsl> and Complete Sentences;* Discrete 
Point vs. Integrative* Testim; Coivrespondence between Test Content 
and Acquisition Order ^ } » 

Re Passive Comprehensi o n : With listening comprdhens ion tasks 
in which students do not actually produce speech, it is often 
difficult to claim that certain test items really test students* 
understanding of a particular grammatical structure; understanding 
one or a few words is often sufficient to get items correct • 

Re The. Value of Phonology or Pronunciation Tests : The "Speak- 
ing" subtest requires repetition of words or sentences spoken by 
the examiner, and is scored for corAct pronunciation. This test 
is subject to the criticisms we presented in this section. 

Re Counting Linguistic Elements ; The sentence Repetition 
task on the "Speaking" subtest is. scored in part by counting the 
number of syllables students produce and matching it with the 
number of syllables in the test sentence. It is unclear what can 
bCjf inferred about language proficiency from students' ability to 
match the number of syllables in a spoken sentence. 



FLliXIWLItY TEST TO MEASURE DOMINANCE IN SPANISH-EI^GLISH BILINGUALS 



AUTIKMIS: 
AVAILABLE FROM: 

DATE: 1974 ; 

TEST INTENDS 
TQ ^MEASURE : 

TAsis INVOLVJED: 



INDEX TO 
PART ONE: 



f 



Gary D, Kell'^r ^ , 

Educational Testing ^Service, ETS Test Collectioji, Princeton, NJ 
08540 (microfiche) 

AGE/GRADE LEVEL: grades 5 and 6 
Spanish-English dominance 

Students are. given a nonsense sequence of eight Tetters and asked 
to construct as many words as possible from those letters, first 
,in' Spanish J then in English; this is repeated five times with dif- 
ferent letters * * . 

Tests that Require Literacy Skills; Tasks that Reduce to a Vo«a|{U- 
lary Test; Understanding the Tpsi; Task; Metalinguistic Instructions 

Re Literacy Skills : The format of this test — spelling wordsr 
from scrambled letters-- is heavily dependent on literacy skills 
in addition to linguistic proficiency. 

Re Tasks that Reduce to a Vocabulary Test ; Beyond reading 
and spelling ability, the one linguistic skill tested is vocabulary 
knowledge; compave other kinds of test tasks that also reduce to 
vocabulary tests as discussed in this section. 

Re Understanding the HTest^Task : The scrambled letter task 
is a kind of language game .only indirectly related to ordinary 
language use. If bilingual students scor^- low on both English 
and Spanish, one reasonable explanatlQi) would be that they have 
not understood the rules of the game being played. 
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HARRIS ARTICULATION TEST 



AUTHORS: , 
AVAILABLE VmU: 

DATl:: 1974 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED; 

INDEX TO 
PART ONE: 



(^ull Harris 

Educational Testing Service, BTS Test Collection, Princeton, NJ 
08540 (microfiche) 



AGn/GRADE- LEVEL: 



Pronunciation 



grades preK-2 



Students name objects represented in pictures, producing particular 
sounds in initial, medial, and final positions 

Tasks that Reduce to a Vocabulary Test; Mimicry; The Value of 
Phonology or Pronunciation Tests; Metalinguistic Instructions 

Re Tasks that Reduce to a Voj:abulary Tes t: Although thl? is 
graded as a pronunciation test, there is also a vocabulary conqx)-^ 
nent to it. Students must name pictures of objects; if the English 
hames of some of the objects are not known, the test will be unable 
to assess whether certainsounds in certain environments can be 
pronounced. On the othefhand, the method of naming pictures does 
avoid the problem of mimicry, which pronunciation tests often 
encounter. 



HAYWARD LANGUAGE. DOMINANCE INDICATOR 



AUTHORS: 

AVAILABLE FROM: 

DATE: None 

TEST INTENDS ' 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: \ 



Office of Bilingual Multicultural Education, Educational Services 
Divi'J^ion, Hayward Unified School District ^ ^ ' . , 

Hayward Unified School District, PO Box 5000, Hayward, CA ^540 

AGE/GRADE LEVEL: grades 

Vocabulary; language use in particular social situations 

The examiner mentions a lo'catlon, and students thirtk of objects 
found Im that location; students answer questions about what lan- 
guage tliey u^e witl> various family members and in certain socikl 
situations ' . 

Self-Reported Data; The Value of Vocabulary Tests; Counting Lin- | 
guistic Elements; Identical Items in Two. Languages 

Re Identic^ Items in TVo/Languages ; On the vocabulary sec- 
tion o^ this test, students produce a list of objects found in 
various locations7-in the kitchen, in the street--flrst in Spanish, 
then in Engfish. As argued here in Part One, it is unnatural from 
the point of . flew of ordinary language use to aslc someone to repeat 
the same information twice. 



ILYIN ORAL INTERVIEW 



AUTHORS: 

AVAILABLE FROM: 

DATBt None 

TEST INTENDS 
10 MEASURE: 



Donna Ilyin 

Newbury Mouse Publishers, 54 Warehouse Rd, Rowley, MA 01969 
AGE/GRADE LEVEL: 12+ years 

♦ 

Oral English production 



ERIC 
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TASKS INVOLVED: 



INUBX TO 
PART ONE: 



Answering^ (and asking) questions about a series of pictures; use 
of specific words or structures is somotimos required 

Mea:»uros of Linguistic Croat iVity; Understanding the Tost Task; 
fillipsls and Complete Sentences; Metalinguistic Instructions; 
Discrete Point vs. Integrative Testing; Correspondence between 
Test Content and Acquisition Order 



JAMKS LANGUAGE DOMINANCE TEST 



AUTHORS: 

AVAILABLE FROM: 

DATE: 1975 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



Peter James 

Learning Concepts, 2 SOI N. Lamar, Austin, TX 78705 
AGE/GRADE LEVEL: grades K and 1 

Vocabulary comprehension; vocabulary production 

Identifying pictures corresponding to words presented orally by 
the examiner; naming objects or activities represented in pictures 
pointed to by the examiner 

The Value of Vocabulary Tests; Metalinguistic Instructions; 
Identical Items in IVo Languages 

Re Identical Items in TVo Languages : This test requires stu- 
dent s^To~T(IentT7y^^TcUnreF^^ in English and Spanish. 
The same pictures dre used for both languages, but not in the, same 
order. Tlie criticisms regarding duplicate items in two languages 
apply to this test. ^ 



LANGUAGE ASSESSMENT BATr^RY 



AUTHORS: 
AVAILABLE FROM: 

DATE : None 

0 ^ 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



Office of Educational Evaluation, New York City Board of Education 

Houghton-Mifflin Co, Test Department, 777 CaLifornia Ave, Palo 
Alto, CA 94304 

AGE/GRADE LEVEL: grades K-^ (Level 1); grades 3-6 (Level 2); 

grades 7-12 (Level 3) 

' 4/ 1 ' 

Speaking; listenings reading (not reviewed); writing (not reviewed) 

Answering personal questions^ naming body parts touched by exam-- 
iner, naming objects in pictures; identifying body parts named 
by the examiner, identifying pictures of objects named by the 
examiner (Level 1); answering the examiner's question, or completing 
the examiner's probe seifitences about pictures (Levels 2 and 3); 
identifying pictures of objects named by- the examiner (Levels 2 and 
3); among three pairs of word^, identifying the one pair pronounced 
exactly the same (Levels. 2 and 3) 

« 

Tasks that Reduce to a Vocabulary Test; Passive Comprehension; The 
Value of Vocabulary Tests; The Value of Phonology tir Pronunciation. 
Tests; Ellipsis and Complete Sentences; Discrete Point vs. Inte- 
grative Testing; Correspondence between Test Content and Acquisi- 
tion Order 

Re Passiv e Comprehension : On the Level 1 test, all the items 
requiring students to speak require only single-word answers* All 
the Items that attempt to assess students* ability to understand 
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grammatical structure are listening items in which students iden- 
tify pictures corresponding to what the examiner says* Thus, the 
test dopentls on evaluating passive listening comproluMision in 
assessing students' control of grammatlcai structure^ Levels 2 and 
5 include speaking tasks which require production of extended 
expressions and grammatical structures, ahd so are not subject to 
the smo criticisms covered in this section. 



LANGUAGE ASSESSMENT SCALES 

AUTHORS: Sharon E. Duncan, Edward A, DeAvila 

AVAILABLE FROM: DeAvila, Duncan ^nd Associates, PO Box 770, Latkspur, CA 94939 

DATE: 1977 (Level 1) AGE/GRADE LEVEL: grades K-5 (Level 1); grades 6+ (Level 2) 
1978 (Level 2) 

TEST INTENDS Perception and pronunciation of English sounds; vocabulary; 

W MEASURE: sentence comprehension; oral production (paraphrase) 

TASKS INVOLVED: Students identify pairs of words presented orally as being the 

same or di fferent ; students name objects represented in pictures; 
students repeat words and sentences presented orally; students 
identify pictures corresponding to sentences presented orally; 
students repeat and paraphrase an orally presented story describing 
a series of pictures 

INDEX TO Tasks that Reduce to a Vocabulary Test; Mimicry; Passive Compre- 

PART ONE: hension; The Value of Vocabulary Tests; The Value Qf Phonology or 

Pronunciation Tests; Discrete Point v's. Integrative Testing 



LANGUAGE DOMINANCE CRITERIA 



AUTHORS: 
AVAILABLE FROM: 

DATE : None 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 




Fernando Canedo, David Gustafson* Am^rico L6pez -Rodriguez 

pilingual-Bicultural Education Program, California State Univer- 
sity, Fullerton, CA 92634 

AGE/GRADE LEVEL: grades K and 1 

Language spoken by students and their family members; speaking 
ability, fluency and grammar 

Students answer questions about what language they speak with 
particular family members and about what language family members 
speak most; students answer personal questions, and, if short 
.answers are given, the examiner asks further questions about what 
students have said 

Self-Reported Data; Identical Items in IVo Languages; Discrete . 
I^oint vs. Integrative Testing 

Re Identical Items in Two Languages : The test includes a 
sociolinguistic questionnaire, which stbdents answer in Spanish 
if they arte able to do so, and a performance section in which 
students answer discussion questions in Spanish. They later 
answer similar questions in English, Since the questions are not 
simply translations, the test avoids the unnaturalness of making 
students answer the same question twice. 

Re Pis cret|^ Point vs, IntegVative Testing : See especially 
the discussion &t this test here* 
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UNGUAGB DOMINANCE SURVEY 



AirniORS : 
AVAILABLE FROM: 



San Bernardino Bilingual Office 

San Bernardino City Unified School District, 799 P St, San Bernar- 
dino, CA 92410 



DATE: 1974-75 AGE/GRADE LEVEL: grades K-1, 2-4, 5-7, 8-12 (separate forms) 



TEST INTENDS 
TO^^SBASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



Listening and* speaking (K-1); for all other iforms, listening com- 
prehension; speaking proficiency; reading comprehension (not 
reviewed); wl^lting proficiency (not reviewed) 

Students identify pictures in response to sentences presented 
orally and answer questions about pictures (K-1); students answer 
questions and perform commands presented orally as well as answeY 
personal questions and produce verbal responses to' a command (2-4); 
students perform commands presented orally, answer personal ques- 
tions, and produce verbal responses to a command (5-7, 8-12) 

Self-Reported Data; Identical Items in Two Languages; Discrete 
4^oint vs. Integrative Testing 

Re Identical Items in TVo Languages : The listening and speak* 
ing sections of this test are presented in English and Spanish. 
The questions and insjtructions are different *in each language, so 
the criticisms developed about duplicate items are avoided. 



LANGUAGE FACILITY TEST 



AUTHORS: 

AVAILABLE FROM: 

DATE: 1977 

TEST INfCNDS 
TO MEASURE: 



TASKS INVOLVED: 

INDEX TO 
PART ONE: 



John T. Dailey 

The Allington Corp, 801 N. Pitt St, #707, Alexandria, VA 22314 

AGE/GRADE LEVEL: 2-15 years ' / 

Students' oral language ability; in particular, students are rated 
on a developmental hierarchy of language ability which runs from 
use of a single word or two through use of sentences and descrip- 
tions ef various degrees of completeness, to telling a complete, 
well-ofganized, imaginative story, including implications, inten- 
tions,' and predictions <^ . 

Students tell a story ^fbout a picture; if response lags, prompting 
is done; three stories about three different pictures are collected 

Notions of Linguistic Complexity; Measures of Linguistic Creativity; 
Discrete Point vs. Integrative Testing 

Re Notions of Linguistic Complexity : The scoring scheme for 
this test is based on a nine-level scale of linguistic complexity 
which is said td represent the levels through which a child prp- 
gresses to reach linguistic maturity. It is. not clear' what research 
this hierarchy is based on. One problem is that the lower levels 
appear to be measuring som'ethin|( very different from the higher 
ones. Up to about Level 5, students* responses are judged accord*- 
ing to their formal characteristics: single word, complete sen- 
tence, verb^of action, etc. In contrast, the highest levels (7, 8, 
and 9) depend on what w6 jnight call "literary** properties of the 
response: completeness, organization, imagination, and creativity. 
TVo Very different kinds of domplexity are involved. 
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LOS NIBTOS SCHOOL DISTRICT LANGUAGE DOMINANCB SURVEY 



AUTIK)RS : 
AVAIUBLB PROM: 

DATE : None 

TEST INTUNDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



Los Nietos School District 

Jos^ Garay, Title VII Director, Los Nietos School District, 
8324 S. Westraan Ave, Whittier, CA 90606 

AGE/GRADE LEVEL: grades K-8 

Language used by various fami4^ members and in various social . 

situations; ability to produceUnd understand English and Spanish 

*■ 

Parents answer questions about the language used by family members 
in different situations; students answer personal questions and 
perform activities directed by the examiner 

Self-Reported Data; Identical Items in TVo Languages 



MARYSVILLE TEST OF LANGUAGE DOMINANCE 



AUTHORS: 
AVAIUBLE FROM: 

DATE: 1977 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



Eleanor Thonis 

Marysville Reading-Learning Center, Marysville Joint Unified 
School District, 1919 B St, Marysville, CA 95901 

AGE/GRADE LEVEL: grades K^S ' ' 

Listening comprehension; speaking; reading (notijjfeviewed) ; 
writing (not reviewed) ;• cultural variables 

Students perform activities directed by the examiner; students 
answer personal questions and perform" d^. verbal task (counting); 
information is gathered from school records and from students 
about what language is used by various family members, the location 
of students • homes, and students' school history 

Self- Reported Data; Identical Items i«\Two Languages 



MAT-SEA-CAL ORAL PROFICIENCY. TEST 



AUTHORS: 

AVAILABLE FROM: 

DATE: 1974 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 




Joseph H. Matluck^ Betty Mace-Matluck 

Seattle Public Schools, 815 Fourth Ave North, Seattle, WA 98109 

AGE/GRADE LEVEL: ^ades K-4 

Listening comprehension: grammar, vocabulary; 
speaking (repetition): pronunciation, grammar; 
speaking: pronunciation, grammar, vocabulary 

Students identify pictures corresponding to sentences or grol 
of sentences spoken by the examiner; students repeat sentences 
spoken by the examiner; students aniwer questions posed by the 
examiner, who provides the first word or two of the desired 
response • , 

Tasks that Reduce to a Vocabulary Test; Mimicry; Passive Comprehen- 
sion; The Value of Phonology or Pronunciatiqm Tests; Ellipsis and 
Complete Sentences; Identical Items In TVo Languages; Discrete 
Point vs. Integrative Testing; Correspondence between Tost Content 
and Acquisition Order ' 
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I^e Tasks that Roduce to a Vocttbulary Tegt ; In the ••Listening 
Compfejiens ion'*' section, stWenVs i^enH^y pictures corresponding to 
tho examiner^s sentences. The problem with such tests, as argued 
in this section, is that some items may not test sentence or struc- 
ture comprehension, but simply vocabulary. This test does attempt 
to distinguish for each item, whether that item tests vocabulary 
or some aspect of structure, but the information is not used in 
scoring. ^ 



MICHIGAN ORAL LANGUAGE PRODUCTIVE TBST 



AUTHORS: 
AVAILABLE FROM: 

DATE: 1970 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



John C, Larson 

Modern Language Association, Publications Center, 62 Fifth Ave, 
New York, NY 10011 ^ 

AGE/GRADE LEVEL: 4-6 years 

Students • ability to produce standard English grammar and pronunci- 
ation; the test is intended for speakers of ESL or for speakers of 
nonstandard English dialects 

Students complete statements begun by the examiner, describing 
pictures; students answer questions about the pictures; students 
ask questions when instructed to by the examiner; in each case, the 
examiner says the first word or two of the desired response 

Ellipsis and Complete Sentences; Discrete Point vs. Integrative 
Testing; Correspondence between Test Content and Acquisition Order 



MORENO ORAL ENGLISH PROFICIENCY PLACEMENT TEST 



AUTHORS: 

AVAILABLE FROM: 

DATE: 1974 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INPEX TO 
PART ONE: 



Steve Moreno 

Moreno Educational Co, 7050 Belle Glade Ln, San Diego, CA 92119 
AGE/GRADE LEVEL: 4-20 years 

Placement and achievement with respect to a' particular English 
curriculum; also, overall English proficiency or degree of bilin- 
gual ism 

Students answer questions posed by the examiner; students repeat 
what the examiner $ays; students ask certain questions when the 
examiner Instructs them to (most questions concern a set of pic- 
tures) 

Mimicry; Inferring Lack of Control from Lack of Performance; Under- 
standing the Test Task; Ellipsis and Complete Sentences; Identical 
Items in TVo Languages; Discrete Point vs. Integrative Testing; 
Correspondence between Test Content and Acquisition Order 

Re Mimicry : A few items on this test are essentially mimicry 
items. For example. Question : Tell me that he is not fl girl; - 
suggested answer: He i& ndt a girl. Question : Tell me that you 
don^t want any candyi suggested answer: , I don't want any candy. 
Th«se items share a certain unnaturalness with the inimicry tasks 
imposed on other tests. Normal conversation does not include these 
kinds bf questions. ^ ^ 

Re Inferring Lack of Conti^l from Lack of Performance : To 
get credit for a correct answer, students must produce the crucial 
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portion of the suggested answer (the portion underlined in the test 
booklet). However, for some items, a correct, appropriate, and 

grammatical answer might fail to include what the item intended to 
el'icit. Under these circumstances, we cannot conclude that stu- 
dents do not control the expression being tested. * . 



MOKENO QUICK LANGUAGE ASSESSMENT INVENTORY 

AUTHORS: 
AVAILABLE FROM: 
DATE: 1974 



TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



Steve Moreno 

Moreno Educational Co, 7050 Belle Glade Ln, San Diego, CA 92119 

AGE/GRADE LEVEL: grades K-6 

Students' language background for determining Englisli/Spanish 
dominance 

l4rents answer questions about the students* native language and 
Education, about the language used at home, at^d about parents' 
/birthplace and education 

Self-Reported Data 



NORTHWESTERN SYNTAX SCREENING TEST 



AUTIHJRS: 
AVAILABLE PROM: 

DATE: 1971 

TEST INTENDS . 
TO MEASURE: 



TASKS INVOLVED: 



INDEX TO 
PART ONE: 



Laura ,L. Lee ^ 

Department t>f Communicative Disorders, Northwestern University, 
Evanston, IL 60201 

AGE/GRADE LEVtL: 3-8 years - ^ ^ 

Understanding and production of English speech sounds; vocabulary; 
comprehension and production of English grammatical forms. 
[This test is intended as a screening instrument for language 
development in native English-speaking children. It is not 
intended to provide a lihguistically detailed diagnosis or t;o 
assess language development in bilinguals or speakers of nonstan- 
dard dialects. However, ''if an examiner w^pshed to know how well 
the children of another dialect group used standard American dia- 
lect in reception and expression, it would be useful for that 
purpose (Manual)."] ^ ' 

Stu'dents identify pictures correspondii^g to sentences spoken by 
the examiner; the examiner presents two sentences orally, points 
to a picture, and students repeat the corresponding sentence 

Mimi-cry; Passive Comprehension; Discrete Point vs. Integrative 
Testing V"^"^ 

■■ f ; 



ORAL LANGUAGE DOMINANCE MEASURE 



AUTHORS; 



' AVAILABLE FROM:/ 



Department of Currijculum and St^aff Development, Bl Paso Public 
Schools ' ' 

Primaryv Acquisition of Languages: A Dual Languaj^e Program, El Paso 
Public '^chools. Department of Curriculum and. Staff Development* El 
Paso, TX\ 79998 • ° 
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DATfil 1978 

TEST INTENDS 
TO MBASURK: 

TASKS INVOLVED: 



INDEX TO 
PART ONE: 



AGB/ GRADE LEVEL: grade!^ K-3 

Grammatical and appropriate langujig© use; total number of words 
produced , ' 

Students' qinswer questions posed by the examiner about a set of 
pictures . ' 

Inferring Lack of Control from Lack of Performance; Counting Lin- 
guistic Elements; Ellipsis and Complete Sentences; Metalinguistic 
Instructions; Identical Items in TVo Languages; Discrete Point vs. 
Integrative Testing; Correspondence between Test Content and Acquir 
sition Order . * 



ORAL LANGUAGE EVALUATION 



AUTHORS: 

AVAILABLE PROM: 

DATE: 1977 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 

INDEX TO 
PART ONE: 



'Nicholas J. Silvaroli, Jann T. Skinner, J.O. Maynes, Jr. 
EMC Corp, 180 East Sixth St, St. Paul, MN 55101 
AGE/GRADE LEVEL: Not indicated 

Oral language ability (^n particular, students are rated on a 
^hierarchy of language development that runs from simple labeling, 
through mor^complex syntactic forms, to abstract story telling) 

Students tell stories affout two pictures; the examiner prompts if 
necessary 

Inferring Lack of Control from Lack of Performance; Understanding 
the Test Task; Measures of Linguistic Creativit)^; Discrete Point 
vs. Integrative Testing . • 

Re Inferring Lack of Control from Lack of Performance ; On 
this test, students tell a 'story wjiich is evaluated according to 
ah assumed developmental hierarchy presented in the Teacher's Man- 
ual . The kind of performance rated highest includes specification 
of cause and effect, mood, emotion, etc. students' failure to 
include these features in the st<fry might result from factors other 
than not being able to specify such featyres. 



OTT TEST OF ORAL LANGUAGE: ENGLISH AND SPANISH 



AUTHORS: 
AVAILABLE PROM: 

DATE: 1970 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



;ndex TO 

PART ONE: 



r.. 



Elizabeth Ott 

Educational Testing Service, ETS test Collection, Princeton, NJ 
08540 (microfiche) ■ 



AGE/ GRADE LEVEL: Not „ indicated 



f 



The pronunciation of English sounds, especially those that may be 
difficult for native Spanish speakers;' the fluency intonation, and 
grammatical oomplexi*ty of students' speech 

Students .report sentences spoken by the examiner; students describe 
pictures. ' , 

Notions of Linguistic Complexity; Mimicry; Inferring Lack of Con- 
trol from Lack of Performance; Self-Reported Data; The Value of 
Phonology or Pronuitciation Tests; Measures of Linguistic, Creativity; 
Understanding the Test Task; Ellipsis and Complete Sentences; 
Identical Items in TVo L.^guages ^ ' 
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Re Measures of Linguistic Creativity ; Some of the questions 
posed by the test require students to exercise some degree of 
imagination in their answers. For example, st^ents are shown a 
picture of girls watching a game and must anst^r the quest ion ^ Httiy 
are the girls watching? Some students may not be as .imaginative in 
their answers or as interested in the test task as others, and may 
not produce elaborate or li-ngulstically conq)lex, answers. According 
to the scoring strategy, these students would not do as well on 
those items. * 



PICTORIAL TEST OF BILINGUALISM AND LANGUAGE DOMINANCE 



AUTHORS : 

AVAILABLE FROM: 

DATE: 1975 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INDEX TO 
PART ONE:. 



Darwin Nelson, Michael J. Fellner, C.L. Norrell ' 

Texas Testing Services, Inc, 401 Poenisch, Corpus Christi, TX 78412 

AGE/GRADE LEVEL: grades pr«K'-2 - . > 

Vocabulary; oral language ability, judged for grammatical correct- 
ness and completeness 

Students identify pictures in their choice of either English or 
Spanish, and then are asked to identify the pictures in the lan- 
guage they did rtot use the first time; students tell a story about 
a picture, first in one language, then the other; probing is done, 

if necessary 

The Value of Vocabulary Tests; Measures of^ijijniguis tic Creativity; 
Ellipsis and Complete Sentences; Metal ingulstils^nstructions; 
Identical Items in Two Languages; Discrete Point v^rirtltegratlve 
Testing " • 



ROBSTOWN INDEPENDENT SCHOOL DISTRICT ORAL LANGUAGE INVENTORY ' 



AUTHORS: 
AVAILABLE FROM: 

DATE: 1^70 

TEST INTENDS 
TO MEASURE: 

TASKS INVOLVED: 



INPEX TO 
PART ONE: 



Irma Garcia, Charlene Washburn 

Bilingu4^~lEducation Program, Robstown Independent School District, 
101 West Ave E, Robstown, TX 78380 

AGE/GIIADE LEVEL: grades K-3, . ' 

Language used or preferred in particular social situations 

Students answer questions about the language they prefer to use 
with particular people arfd in particular situations 

tests that Require Literacy Skills ; Self-Reported Data 



SHORT TEST OF. LINGUISTIC SKILLS 

AUTHORS: Department of Research and Evaluation, Chicago Board of Education 

AVAILABLE FROM: Department of Research and Evaluation, J3lif8'go Board of Education, 

Rm 215, 2021 N. Burling St, Chicago, IL 60641 ' 



DATE: 1976 



AGE/GRADE LEVEL: 8-13 years 
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TEST INTENDS 
TO 'MEASURE: 

TASKS INVjOLVLD: 



INDEX TO 
PART ONE: 



Listening; reacjiing (not reviewed); writing (not •rjeViewed) ; speaking 

I 

Listoning: students cliop^c word:^; spoken by the examiner from a 
written multiple-'Choice list; write words; phrases, and sentences 
from^dictat ion; ^answer yes/no questions; . follow directions pre- 
sented orally, many of which require writing. Sp&aking: students 
answer personal and general questions; describe' objects a,nd activ- 
ities; answer questions about' Chicago; describe a picture in five 
complete sentences x 

Tests that Require Literacy Skills; Notions of Linguistic Complex- 
ity; Measures of Lingu^-stic Crealivity; Ellipsis and Cbmplete 
Sentences; Discrete Point v5, «||jkrative Testing' 

Re Measures of Linguistic CfWtivity : In scoring the. speaking 
section, judgments must be' niad^ about '^•m^jor" and '*minor" gram- 
matical errors.; No useful assistance is provided for distinguish- 
ing between major, and minor eri^ors./ Soihe attempt iihould be made to 
define what is considered, a major versus a minor grammatical, error, 
and indeed what is considered a grammatical error* Many stylistic 
and colloquial deviations -from formally "correctV English should 
probably not be considered errorS\for purposes of an English profi- 
ciency test.^ ■ K 



SHUTT PRIMARY LANGUAGH INDICATOR TliST 



AUTHORS: 
AVAILABLE FROM: 
DATH: 1976 

TEST TNTENDS 
TO MEASURE: * 

TASKS INVOLVED: 

INDEX. TO 

PART ONE: • , 



D.L. Shutt 

Webster Division, McGraw-Hill, 8171 Redwood IKvy, Novato, CA 94947 • 

^AGE/GRADE LEVEL: graces 'K-6 (li|(tening and verbal fluency) 

grades (reading comprehension and grammar) 

Listening comprehejnsi^n; verbal fluency; readijig comprehension and 
gramma^ (not reviewed) \ . 

Students id^tify pictures correspohding to what the examiner saysj 
students describe pictures and answer specific questions' about them 

Tasks that> Reduce to la Vocabulary, Test; Passive Comprehension; 
Understanding the Test Task * / 

Re Passive Comprehension ; Hie "Listening Comprehension" sec- 
tion of this test seeks to test student's' proficiency without 
^actually making them produce speech. 



SKOCZYLAS ENGLISH PHONEMIC UNIT PRODUCTION TEST 



AUTHORS: 

AVAILABLE FROM: 

DATE: 1972 

TRST INTENDS 
.TO MEASURE: 

TASKS INVOLVED: 

INDEX TO ' 
PART ONE: , . 



Rudcflph V, Skoczylas „ ' . ' 

R.V. Skoczylas, 7649 Santa Inez Ct, Gilroy, CA 95020 
AGE/GRADE I.EVEL: 5-adult 

Correct pronunciation of English speech sounds • 
Repeating sentences spoken .by the. examiner 

Mimicry; Tasks jthat Reduce to a Vocabulary Test; The Value of 
Phonology or Pronunciation Tests 
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SKOCZYLAS Home bilingual usage estimate 
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AimiORS: Ruilolph V. Skoczylas 

AVAILABLE FROM: R.V. Skoczylas, 7649 Santa Inez Ct, Gilroy, CA 95020 

DATE: 1971 AGE/GRADE LEVEL: Not indicated 

TEST INTENDS Students' linguistic background; language used by students' vaidous 

TO MEASURE: family members 

TASKS INVOLVED: Adults answer question^ about languajjje between students and 

family members and between other family^rembers 

INDEX TO ^ 
PART ONE: ^If-Reported Data 

SPANISH- ^GLISH DOMINANCE ASSESSMENT TEST * ► 
AUTHORS: Bernard Spolsky, Penny Murphy 

AVAILABLE FROM: Educational Testing Service, ETS Test Collfcction, Princeton, NJ 

08540 (microfiche) ' 

dAt'E: 1972 • AGE/GRADE LEVEL: grades 1-2 • ' 

TEST INTENDS Oral language production; vocabulary; use and understanding of 

TO MEASURE:' English and Spanish in particular social situations 

TASKS INVOLVED: Students answer personal questions, questions about their own lan- 
guage use and understanding; name objicts that might be^fQund In 
, particular places; produce connected speech describi^ a pr^ture 

INDEX TO -Self-Reported "Data; The Value of Vocabulary Tests; 

PART ONE: Instructions; Identical Items in Two Languages 




SPANISH/ENGLISH LANGUAGE PERFORMANCE SCREENING . * 

AUTJiDRS: Southwest Educational Development Laboratoiy 

AVAILABLE FROM: CTB/McGraw-Hil 1 , Del Monte Research Park, Monterey > CA 93940 

DATE: 1976 AGE/GRADE LEVEL: 4-5^years 

TEST INTENDS Oral language ability, judged according to number, length, and- 

TO MEASURE: complexity of responses 

TASKS INVOLVED: Students answer personal questions; name objects; follow oral 

directions; describe objects and pictures 

INDEX TO Notions of Linguistic Complexity; Metalinguistic Instructions; 

PART ONE: Identical Items in Two Languages; Discrete Point vs. Integrative 

* Testing 

Re Notions of Linguistio Complexity : As part of the procedure 
■for determining language dominance, the humber, length*, and com- 
^ * plexity of responses on the English section are corppared .with the 
responses on tlje Spanish section. No guidelines are provided for 
making this comparison. Judging the complexity of a response* is 
likely to be a difficult and subjective matter> and comparing the 
complexity of responses in two different languages even more 
. difficult* ^ * ^ 

fte Identical Items in Two Languages : Questions asked on each 

SI ^ * 
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language section are parallejl» but not »»re translations. Hils 
test avoids the unnaturalness of asking students thp same question 

twice. 



TEST OF GRAWIATICALLY CORRECT SPANISH/ ENGLISH 



AMTHORS: 
AVAILABLE PRQM: 

DATE: None 

TEST INTENDS 
TO MEASURE: 

1 

I 

TASKS. INVOLVE^: 

INDEX TO 
PART ONE: 



Las Cruces Public Schools 

Margarita L6pez do Mestas, Coordinator, Bilingual Education Proj- 
ect, Las Cruces Public Schools, 301 W. Amador Ave, Las Cruces, NM 
88001 

AGE/GRADE LEVEL: grades K-4 

Correctness of grammatical form and spelling in a written story 
(not reviewed); average oral sentence length, number of uncommon 
words, total number of syllables used: grammatical complexity and 
correctness; pronunciation 

Students answer two questions in Spanish; then two different .ques- 
tions in English; probing is done if necessary (oral test) 

Notions of Linguistic Complexity; Inferring Lack of Control ^rom 
Lack^of Performance; The Value of Phonology or Pronunciation Tests^ 
Counting Linguistic Elements; Identical Items in Two Languages; 
Discrete Point vs. Integrative Testing 
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INDEX 



feAHIA ORAL LANGUAGE TEST 29, j1, 36 , 

BASIC INVENTORY OF NATURAL LANGUAGE^ 18, 19, 22, 25', 27, 28, 36 
BILINGUAL SYNTAX MEASURE 23, 25, 29, 31, i7 
BROOKS CXDUNTY LANGUAGE USAGE INVENTORY, 12, 13, 37 

CASO TEST FOR NON- ENGLISH SPEAKING STUDENTS 17, 22, 29, 30, 37 
CHICAGa SM SHORT TEST OF LINGUISTIC SKILLS ""^ 
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LANGUAGE DOMINANCE SURVEY 12, 27, 44 
LANGUAGE FACILITY TEST 17, 18, 27,"T8, 44 
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• 
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LANGUAGE IN HDUGATION: TIIHORY AND PRACTICI! 
Vohiino 1 (l«)77-78) ' 

1. Di rectory of t'or eign Unttuage Service OManizations,. by Sophia B*l\rciis. $3.95. 

Tin 1S3 503 y 

^' Hio Linguist in Speech Patholo}^^, by Walt Wolfram. $2.9S. liP 153 S04 

3. Graduate 'IlACst^s _un£ Uissortajjmis^ in Jlin^ as »_S.*'C5)nd Lan^u'a^e: 1976-77, by 
S"to^l)]ien' CoopcTr.' l2.T)5.'"' FD 1 53 S05 ' ' " '~ . 

^* ^lQ5j[^-^.y'V^-^*^^"{{ " "'^^ Classroom Teac her, by Guadalupe Va Idcs-I'a 1 1 Is . $2.95'. 
liD ir>3"liO() ~ " 

5. Current Approaches to the Tea ching of Grammar in^ liSL, by David M, DtJvidsou. 
.f2T9^. HI) 1S4 ()20 ^ / 

6. I'rom t lie Commu t uty t o the Classroom: Gathering Second-Language Speech Samples, '■ 

r;r^iT^TrFirTrT"i^;j^-$^05. i:n m ~ — ■ ' — ^ — ' 

^* KniesU^^and Cnlss *Cultural Understan ding, by tonelle G. Mora in. $2.95.. 

^- New Terspe^ct i ves oh T eaclii ng Vocabulary , by Howard H. Keller. $2.95. r,D.157 406 

9. T eacher Talk: L anguage in the Classroom, by Shirley B. Heath. $2.95. HD 158 575 

Language an d Linguisgics :-«Bases for a Curriculum, by Julia S. l-alk. $2.95. . 
LD 158 57(> ~ . 

11^ Teachin g Ciultu re: Strat egies and Techn it^^ues, by Robert C. Lafayette. $2.95. 
|;D 157 407 ~~ 
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Personality and Second Language Learning , by Virginia D. Ilodge. $2.95. 
I-:D 157 408 V. 



Volume 2 (I 978-79) 

13. Games and Simulations i n the I'oreign La nguage Classroom, by Alice C. Omaggio. 
$5.05. ■ ^ ■ 

14. Problems and leaching Strate gi es in ESL Composition , by Ann Raimes. $2. 95.' 

15. Graduate -'llieses a nd Dissertati on s in Lngl ish as a Second Language: 1977-78 , by . 
Stephen CooTper. $2.95. ~ ' 

1 () . l-orcign Languages, Hnglis h a s a Second/Fore ign Language, and the U.S. Multi- • 
national Corporation, by Kfarianne" fnman. $4795. 

, ^ 

17. Testing Oral Com municat ion in the Foreign Language Clas sroom, by Walter H. Barfz; 
$2.95. " 

18. Intensive l-orci gn Language Courses , by David P. Benseler and Renate A. Schulz. 

$:'>.95. 

19. livaluating a Second Language Program , by Gilbert A. Jarvis and Shirley J. Adams. 
$2.95. 

20. Reading a Second Languap , by Truett Gates and Janet K. Swaffar. $2.95. 

21. Chicano Bnglish , by Allan A. Metc^lf. $2*95. 

22. Ad ult V ocational KSL , by Jo Ann Crandall. $5.95. 

Volume 3 (1979-80) 

23» A Lingui sti c Guide to Hnglish Pi^cfficiency Testing in Schools ^ by Cecilia Freeman 
and Tliomas^ G. Dietericlu $5.95. 

To subscribe to the complete serftes of publications? , write to the Publications 
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